-- Logs begin at Tue 2022-07-12 17:26:15 UTC, end at Tue 2022-07-12 18:49:33 UTC. -- Jul 12 18:16:08.555721 dv-cinder-844881-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 18:16:08.563746 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 18:16:08.566725 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 18:16:08 2022] *** Jul 12 18:16:08.566725 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 18:16:08.566725 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 18:16:08.566725 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: nodename: dv-cinder-844881-1-iscsi Jul 12 18:16:08.566725 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: machine: x86_64 Jul 12 18:16:08.566725 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: clock source: unix Jul 12 18:16:08.566725 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: pcre jit disabled Jul 12 18:16:08.566725 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: detected number of CPU cores: 4 Jul 12 18:16:08.566725 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: current working directory: / Jul 12 18:16:08.566725 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: detected binary path: /usr/bin/uwsgi-core Jul 12 18:16:08.567370 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: your processes number limit is 47680 Jul 12 18:16:08.567370 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: your memory page size is 4096 bytes Jul 12 18:16:08.567370 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: detected max file descriptor number: 2048 Jul 12 18:16:08.567370 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: lock engine: pthread robust mutexes Jul 12 18:16:08.567370 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: thunder lock: enabled Jul 12 18:16:08.567370 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 18:16:08.567370 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 18:16:08.610463 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: Python main interpreter initialized at 0x55a1404959c0 Jul 12 18:16:08.610463 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: python threads support enabled Jul 12 18:16:08.610463 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: your server socket listen backlog is limited to 100 connections Jul 12 18:16:08.610463 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: your mercy for graceful operations on workers is 90 seconds Jul 12 18:16:08.610851 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 18:16:08.610851 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: *** Operational MODE: preforking *** Jul 12 18:16:08.611125 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: *** uWSGI is running in multiple interpreter mode *** Jul 12 18:16:08.611125 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: spawned uWSGI master process (pid: 103850) Jul 12 18:16:08.611329 dv-cinder-844881-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 18:16:08.612129 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: spawned uWSGI worker 1 (pid: 103851, cores: 1) Jul 12 18:16:08.612292 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: spawned uWSGI worker 2 (pid: 103852, cores: 1) Jul 12 18:16:08.612473 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 18:16:09.279463 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 18:16:09.289077 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 18:16:10.421814 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:16:10.421814 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: from cryptography.utils import int_from_bytes Jul 12 18:16:10.422511 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:16:10.422511 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: from cryptography.utils import int_from_bytes Jul 12 18:16:10.422915 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:16:10.422915 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: from cryptography.utils import int_from_bytes Jul 12 18:16:10.423034 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:16:10.423034 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: from cryptography.utils import int_from_bytes Jul 12 18:16:12.907155 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:16:12.907729 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:16:12.907845 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:16:12.907845 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:16:12.908245 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:16:12.908343 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:16:12.908431 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:16:12.908562 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:16:12.908704 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:16:12.908948 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.909062 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:16:12.909273 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.909379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.909589 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.909679 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.909907 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.910004 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.910235 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.910332 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.910542 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.910639 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.910847 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.910931 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.911160 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.911248 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.911476 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.911561 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.911732 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.911825 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.912036 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.912121 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.912367 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.912456 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844881-1-iscsi {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.912689 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844881-1-iscsi {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.912776 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.912992 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.913077 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.913294 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.913378 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.913596 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.913699 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.913898 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.913982 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.914194 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.914290 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.914506 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.914599 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.914801 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.915002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.915297 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.915437 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.915602 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.915726 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.915898 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.916017 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.916221 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.916402 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.917250 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.917431 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.917514 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.917633 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.917822 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.917911 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.918134 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.918233 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.918458 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.918543 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.918781 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.918986 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.919111 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.919209 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844881-1-iscsi {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.919446 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844881-1-iscsi {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.919537 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.919756 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.919840 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.920061 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.920155 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.920389 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.920493 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.920790 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.920888 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.921094 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.921180 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.921393 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.921480 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.921712 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.921821 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.922012 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.922097 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.922309 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.922396 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.922630 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.922725 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.922943 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.923040 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.923253 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.923338 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.923551 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.923636 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.923853 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.923936 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.924156 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.924248 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.924491 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.924578 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.924798 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.924892 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.925103 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.925188 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.925350 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.925442 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.925655 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.925746 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.925956 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.926048 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.926270 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.926355 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.926583 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.926674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.926830 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.926924 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.927077 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.927226 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.927361 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.927446 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.927672 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.927759 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.927985 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.928071 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.928289 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.928398 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.928613 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.928706 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.928911 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.928997 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.929211 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.929316 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.929507 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.929599 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.929806 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.929888 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.930101 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.930194 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.930401 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.930494 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.930714 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.930826 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.931034 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.931137 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.931340 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.931432 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.931656 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.931742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.932034 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.932146 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.932945 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.933031 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.933179 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.933262 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.933495 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.933591 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.933812 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.933897 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.934121 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.934207 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.934437 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.934531 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.934753 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.934838 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.935058 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.935141 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.935358 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.935443 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.935655 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.935741 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.935957 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.936041 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.936271 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.936399 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.936604 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.936688 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.936853 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.936938 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.937137 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.937222 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.937429 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.937522 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.937727 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.937825 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.938033 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.938117 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.938334 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.938419 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.938634 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.938728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.938926 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.939010 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.939217 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.939311 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.939516 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.939657 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.939814 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.939905 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.940111 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.940195 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.940432 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.940533 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.940733 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.940817 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.941030 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.941115 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.941330 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.941424 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.941626 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.941711 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.941923 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.942009 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.942233 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.942320 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.942536 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.942620 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.942834 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.942925 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.943133 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.943221 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.943435 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.943529 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.943735 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.943820 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.944038 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.944130 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.944355 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.944443 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.944659 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.944744 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.944964 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.945050 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.945261 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.945345 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.945559 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.945646 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.945861 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.945957 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.946159 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.946250 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.946458 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.946544 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.946753 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.946838 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.947049 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.947133 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.947348 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.947433 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.947647 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.947732 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.947995 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.948143 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.948297 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.948617 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.948711 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.948915 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.949000 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.949212 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.949341 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.949510 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.949602 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.949805 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.949900 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.950100 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.950184 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.950394 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.950480 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.950688 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.950780 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.950999 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.951092 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.951302 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.951404 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.951603 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.951701 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.951902 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.951994 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.952201 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.952300 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.952537 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:16:12.952634 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.952866 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.952965 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.953193 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.953287 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.953521 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.953614 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.953829 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.953922 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.954155 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.954239 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.954466 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.954560 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.954777 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.954871 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.955080 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.955172 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.955388 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.955474 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.955694 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.955778 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.955999 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.956084 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.956323 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.956428 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.956697 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.956784 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.957010 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.957120 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.957321 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.957416 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.957634 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.957719 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.957943 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.958034 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.958249 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.958333 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.958558 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.958644 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.958862 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.958960 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.959173 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.959266 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.959486 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.959575 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.959800 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.959885 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.960106 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.960191 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.960477 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.960623 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.960791 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.960877 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.961100 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.961194 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.961410 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.961496 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.961719 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.961813 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.962024 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.962122 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.962330 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.962420 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.962636 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.962723 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.962954 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.963048 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.963268 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.963353 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.963785 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.963871 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.964105 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.964335 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.964430 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.964513 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.964733 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.964836 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.965038 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.965128 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.965343 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.965438 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.965653 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.965748 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.965977 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.966065 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.966285 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.966378 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.966595 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.966683 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.966901 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.966988 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.967209 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.967295 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.967515 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.967601 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.967816 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.967903 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.968120 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.968206 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.968439 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.968530 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.968742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.968832 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.969042 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.969129 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.969343 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.969472 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.969684 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.969839 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.969973 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.970055 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.970264 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.970360 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.970562 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.970647 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.970872 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.970960 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.971173 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.971268 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.971474 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.971558 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.971774 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.971859 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.972074 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.972168 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.972396 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.972491 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.972695 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.972779 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.973001 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.973089 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.973300 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.973387 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.973597 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.973692 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.973907 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.973994 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.974205 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.974292 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.974505 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.974589 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.974806 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.974892 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.975105 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.975191 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.975411 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.975496 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.975712 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.975805 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.976016 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.976103 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.976357 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.976465 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.976643 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.976739 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.976951 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.977043 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.977257 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.977356 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.977562 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.977649 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.977884 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.977970 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.978206 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.978301 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.978503 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.978595 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.978818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.978904 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.979953 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.980104 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.980262 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.980367 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.980587 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.980673 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.980895 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.980984 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.981195 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.981281 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.981493 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.981579 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.981791 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.981886 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.982093 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.982180 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.982391 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.982529 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.982687 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.982785 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.982980 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.983075 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.983276 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.983364 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.983605 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.983692 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.983921 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.984007 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.984224 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.984350 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.984547 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.984634 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.984840 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.984926 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.985135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.985230 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.985471 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.985560 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.985769 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.985862 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.986103 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.986198 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.986418 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.986509 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.986726 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.986819 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.987039 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.987136 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.987343 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.987434 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.987650 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.987742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.987950 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.988037 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.988255 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.988369 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.988609 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.988695 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.988917 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.989004 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.989233 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.989319 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.989537 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.989622 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.989850 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.989950 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.990157 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.990295 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.990467 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.990596 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.990765 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.990852 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.991075 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.991161 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.991371 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.991464 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.991679 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.991766 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.992010 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.992097 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.992347 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.992448 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.992659 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.992755 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.992969 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.993056 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.993274 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.993445 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.993579 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.993664 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.993881 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.993967 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.994184 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.994278 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.994486 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.994581 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.995358 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.995463 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.995675 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.995775 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.995983 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.996072 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.996296 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.996420 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.996622 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.996711 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.996936 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.997022 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.997240 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.997325 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.997554 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.997641 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.997852 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.997945 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.998159 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.998246 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.998480 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.998573 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.998785 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.998869 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.999099 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.999183 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.999402 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.999488 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.999710 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:12.999795 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.000014 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.000169 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.000345 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.000456 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.000635 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.000722 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.000934 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.001035 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.001236 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.001330 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.001541 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.001625 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.001850 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.001949 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.002153 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.002239 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.002454 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.002538 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.002754 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.002859 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.003050 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.003143 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.003351 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.003439 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.003648 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.003735 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.003946 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.004034 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.004252 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.004356 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.004591 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.004678 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.004898 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.004982 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.005197 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.005288 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.005499 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.005627 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.005806 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.005901 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.006104 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.006197 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.006403 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.006488 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.006704 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.006797 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.007001 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.007093 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.007298 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.007397 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.007596 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.007682 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.007924 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.008018 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.008230 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.008369 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.008553 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.008653 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.008861 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.008960 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.009174 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.009260 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.009476 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.009560 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.009780 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.009873 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.010082 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.010204 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.010428 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.010603 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.010718 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.010973 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.011077 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.011290 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.011378 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.011600 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.011704 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.011903 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.012002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.012208 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.012295 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.012536 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.012637 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.012852 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.012951 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.013158 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.013244 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.013461 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.013557 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.013763 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.013852 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.014059 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.014146 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.014365 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.014454 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.014677 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.014940 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.015234 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.015328 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.015563 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.015658 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.015874 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.015961 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.016187 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.016275 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.016527 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.016618 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.016842 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.016929 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.017168 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.017253 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.017489 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.017577 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.017804 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.017901 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.018110 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.018277 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.018413 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.018500 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.018713 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.018801 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.019014 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.019109 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.019315 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.019402 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.019613 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.019702 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.019912 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.019999 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.020209 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.020331 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.020536 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.020633 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.020837 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.020939 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.021141 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.021249 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.021441 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.021537 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.021745 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.021875 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.022043 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.022139 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.022339 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.022433 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.022638 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.022725 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.022941 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.023054 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.023250 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.023337 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.023552 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.023639 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.023847 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.023944 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.024145 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.024234 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.024465 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.024567 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.024804 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.024902 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.025102 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.025197 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.025437 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.025526 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.025761 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.025857 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.026104 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.026198 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.026409 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.026503 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.026707 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.026795 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.027020 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.027106 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.027316 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.027401 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.027615 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.027712 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.027914 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.028000 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.028216 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.028330 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.028540 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.028629 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.028835 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.028921 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.029140 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.029237 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.029442 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.029536 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.029743 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.029831 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.030042 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.030139 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.030335 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.030473 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.030641 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.030752 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.030936 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.031049 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.031242 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.031349 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.031543 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.031665 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.031841 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.031973 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.032147 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.032274 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.032476 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.032601 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.032776 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.032909 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.033083 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.033207 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.033384 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.033509 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.033698 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.033788 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.033998 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.034084 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.034296 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.034382 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.034594 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.034690 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.034900 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.034991 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.035205 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.035306 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.035504 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.035591 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.035817 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.035903 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.036122 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.036221 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.036450 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.036539 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.036750 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.036837 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.037048 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.037146 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.037350 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.037439 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.037646 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.037742 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.037945 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.038041 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.038248 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.038336 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.038564 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.038649 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.038868 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.038957 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.039164 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.039264 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.039465 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.039551 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.039761 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.039857 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.040063 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.040149 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.040380 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.040483 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.040699 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.040838 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.040980 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.041066 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.041280 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.041387 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.042091 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.042191 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.042394 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.042491 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.042693 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.042799 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.043013 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.043123 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.043325 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.043425 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.043624 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.043733 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.043924 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.044020 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.044222 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.044348 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.044577 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.044685 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.044888 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.044982 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.045229 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.045336 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.045532 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.045636 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.045843 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.045941 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.046150 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.046236 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.046457 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.046547 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.046765 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.046860 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.047070 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.047166 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.047371 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.047460 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.047677 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.047765 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.047982 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.048069 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.048281 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.048398 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.048603 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.048690 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.048900 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.048988 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.049217 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.049305 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.049523 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.049611 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.049830 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.049918 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.050146 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.050241 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.050462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.050548 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.050762 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.050869 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.051066 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.051163 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.051424 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.051581 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.051667 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.051755 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.051959 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.052047 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.052260 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.052378 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.052604 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.052702 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.052909 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.052999 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.053217 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.053305 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.053523 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.053620 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.053826 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.053919 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.054129 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.054218 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.054428 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.054517 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.054731 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.054817 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.055030 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.055123 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.055329 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.055425 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.055643 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.055736 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.055946 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.056033 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.056243 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.056394 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.056567 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.056654 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.056864 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.056951 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.057224 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.057346 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.057518 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.057657 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.057941 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.058039 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.058250 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.058338 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.058556 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.058650 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.058854 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.058951 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.059160 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.059254 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.059465 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.059558 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.059773 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.059869 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.060077 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.060163 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.060405 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.060496 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.060806 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.060916 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.061115 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.061205 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.061420 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.061542 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.061718 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.061805 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.062015 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.062108 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.062313 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.062400 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.062619 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.062708 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.062920 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.063007 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.063224 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.063313 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.063522 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.063609 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.063818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.063904 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.064125 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.064211 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.064444 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.064533 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.064761 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.064878 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.065169 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.065275 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.065475 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.065571 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.065774 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.065882 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.066180 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.066276 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.066485 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.066573 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.066791 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.066878 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.067108 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.067202 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.067425 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.067512 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.067726 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.067819 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.068034 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.068136 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.068357 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.068466 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.068663 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.068758 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.068981 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.069068 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.069289 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.069386 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.069593 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.069687 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.069892 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.069986 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.070186 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.070275 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.070502 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.070590 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.070811 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.070944 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.071118 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.071214 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.071432 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.071520 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.071832 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.071928 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.072142 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.072232 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.072483 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.072570 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.073310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.073411 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.073613 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.073704 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.073916 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.074003 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.074215 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.074312 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.074516 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.074603 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.074812 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.074899 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.075111 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.075209 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.075421 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.075507 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.075718 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.075805 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.076024 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.076120 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.076344 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.076435 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.076649 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.076735 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.076945 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.077045 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.077240 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.077328 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.077547 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.077633 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.077843 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.077940 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.078158 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.078247 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.078466 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.078552 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.078779 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.078868 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.079080 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.079167 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.079376 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.079462 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.079690 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.079779 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.079989 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.080076 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.080284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.080442 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.080602 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.080719 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.080899 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.081023 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.081224 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.081320 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.081520 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.081607 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.081831 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.081928 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.082152 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.082250 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.082461 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.082555 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.082765 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.082852 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.083091 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.083193 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.083401 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.083488 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.083711 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.083804 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.084020 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.084122 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.084415 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.084521 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.084640 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.084730 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.084950 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.085040 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.085252 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.085346 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.085555 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.085675 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.085844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.085947 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.086140 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.086239 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.086435 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.086523 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.086730 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.086818 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.087026 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.087112 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.087321 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.087407 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.087631 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.087717 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.087927 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.088012 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.088240 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.088425 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.088611 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.088787 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.088968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.089099 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.089375 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.089473 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.089698 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.089784 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.090006 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.090091 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.090334 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.090434 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.090651 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.090736 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.090964 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.091065 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.091287 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.091453 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.091595 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.091733 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.091886 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.092021 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.092199 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.092367 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.092536 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.092627 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.092847 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.092933 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.093157 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.093245 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.093468 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.093558 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.093777 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.093864 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.094087 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.094184 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.094394 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.094483 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.094695 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.094781 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.095004 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.095093 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.095319 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.095406 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.095624 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.095851 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.096161 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.096257 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.096496 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.096585 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.096804 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.096902 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.097110 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.097197 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.097415 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.097502 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.097722 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.097823 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.098028 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.098115 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.098332 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.098419 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.098635 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.098724 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.098937 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.099024 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.099241 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.099330 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.099567 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.099664 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.099886 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.099975 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.100208 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.100296 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.100546 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.100636 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.100863 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.100953 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.101170 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.101266 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.101480 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.101571 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.101790 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.101877 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.102130 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.102229 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.102434 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.102526 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.102736 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.102822 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.103049 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.103138 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.103357 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.103443 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.103665 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.103758 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.103970 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.104918 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.105079 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.105354 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.105444 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.105673 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.105782 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.105983 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.106071 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.106294 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.106382 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.106609 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.106707 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.106923 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.107010 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.107246 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.107341 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.107576 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.107672 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.107892 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.107980 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.108202 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.108293 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.108538 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.108626 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.108848 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.108935 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.109363 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.109461 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.109673 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.109760 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.110000 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.110087 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.110322 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.110425 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.110640 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.110726 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.110952 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.111038 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.111262 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.111363 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.111582 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.111673 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.111883 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.111969 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.112181 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.112285 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.112511 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.112610 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.112814 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.112901 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.113114 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.113204 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.113430 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.113524 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.113735 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.113821 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.114034 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.114122 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.114346 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.114433 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.114649 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.114737 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.115177 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.115267 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.115527 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.115624 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.115842 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.115930 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.116166 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.116255 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.116514 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.116602 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.116830 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.116931 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.117136 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.117230 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.117458 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.117544 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.117763 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.117871 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.118066 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.118158 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.118378 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.118466 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.118685 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.118789 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.118986 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.119073 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.119285 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.119380 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.119609 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.119768 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.120018 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.120113 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.120436 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.120528 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.120751 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.120842 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.121056 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.121146 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.121378 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.121465 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.121682 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.121780 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.121982 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.122079 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.122283 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.122372 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.122590 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.122679 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.122890 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.122978 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.123190 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.123277 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.123488 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.123578 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.123789 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.123883 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.124096 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.124194 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.124416 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.124518 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.124722 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.124810 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.125022 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.125125 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.125331 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.125417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.125628 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.125714 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.125929 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.126027 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.126273 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.126360 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.126588 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.126674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.126888 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.126989 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.127188 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.127276 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.127498 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.127584 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.127802 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.127901 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.128120 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.128215 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.128449 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.128551 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.128759 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.128849 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.129100 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.129195 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.129412 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.129500 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.129940 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.130029 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.130270 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.130358 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.130585 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.130681 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.130912 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.131002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.131236 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.131324 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.131538 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.131634 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.131836 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.131934 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.132134 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.132230 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.132477 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.132585 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.132790 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.132886 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.133100 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.133188 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.133408 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.133506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.133719 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.133807 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.134027 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.134118 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.134335 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.134433 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.134640 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.134728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.134944 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.135030 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.135767 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.135863 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.136122 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.136209 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.136526 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.136633 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.136831 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.136922 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.137133 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.137230 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.137442 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.137540 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.137777 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.137866 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.138090 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.138178 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.138402 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.138499 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.138711 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.138800 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.139023 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.139183 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.139327 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.139445 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.139634 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.139723 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.139943 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.140032 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.140250 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.140439 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.140587 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.140675 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.140912 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.140999 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.141218 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.141307 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.141517 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.141604 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.141938 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.142033 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.142246 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.142334 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.142561 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.142654 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.142878 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.142966 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.143184 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.143275 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.143501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.143587 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.143816 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.143912 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.144124 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.144211 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.144464 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.144557 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.144771 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.144871 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.145096 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.145184 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.145429 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.145516 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.145752 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.145915 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.146072 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.146160 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.146373 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.146470 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.146673 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.146776 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.146972 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.147061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.147276 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.147366 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.147591 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.147710 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.147894 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.147982 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.148189 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.148275 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.148520 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.148824 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.149119 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.149427 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.149718 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.150033 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.150387 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.150748 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.151103 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.151520 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.151989 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.152204 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.152577 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.152747 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.152903 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.153054 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.153195 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.153350 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.153496 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.153670 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.153827 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.153983 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.154127 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.154277 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.154423 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.154584 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.154730 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.154900 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.155053 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.155196 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.155344 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.155511 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.155656 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.155822 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.155982 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.156125 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.156267 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.156449 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.156551 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.156767 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.156868 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.157076 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.157217 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.157384 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.157480 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.157688 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.157789 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.157990 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.158077 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.158295 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.158394 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.158604 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.158700 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.158911 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.159006 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.159218 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.159313 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.159524 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.159621 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.159829 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.159961 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.160181 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.160286 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.160497 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.160602 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.160883 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.161013 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.161138 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.161234 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.161457 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.161553 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.161769 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.161870 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.162104 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.162237 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.162416 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.162558 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.162817 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.162961 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.163144 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.163281 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.163492 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.163603 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.163922 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.164024 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.164269 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.164401 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.164677 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.164788 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.164994 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.165079 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.165323 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.165411 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.165651 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.165744 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.165974 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.166119 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.166338 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.166966 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.167274 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.167424 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.167579 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.167716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.167912 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.168010 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.168230 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.168400 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.168565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.168745 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.168884 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.169136 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.169237 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.169489 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.169596 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.169807 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.169945 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.170141 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.170303 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.170427 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:16:13.170524 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.170756 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.171073 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.171395 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.171720 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.172069 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.172402 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.172872 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.173088 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.173402 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.173718 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.174024 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:16:13.174273 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:16:13.237076 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO dbcounter [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Registered counter for database nova_api Jul 12 18:16:13.238041 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO dbcounter [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] Registered counter for database nova_api Jul 12 18:16:13.351279 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_db.sqlalchemy.engines [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:16:13.352813 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG oslo_db.sqlalchemy.engines [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:16:13.358317 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writer thread running {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:16:13.359464 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG dbcounter [-] [103852] Writer thread running {{(pid=103852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:16:13.413803 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.context [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6a061b3-df1d-42b4-9542-23af2c3404e0(cell1) {{(pid=103851) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 18:16:13.414071 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.context [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6a061b3-df1d-42b4-9542-23af2c3404e0(cell1) {{(pid=103852) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 18:16:13.417937 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:16:13.418166 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG oslo_concurrency.lockutils [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:16:13.419523 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:16:13.419732 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG oslo_concurrency.lockutils [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:16:13.420337 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:16:13.420555 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG oslo_concurrency.lockutils [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:16:13.422410 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:16:13.422621 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG oslo_concurrency.lockutils [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:16:13.424413 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO dbcounter [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Registered counter for database nova_cell0 Jul 12 18:16:13.424626 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO dbcounter [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] Registered counter for database nova_cell0 Jul 12 18:16:13.428279 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO dbcounter [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Registered counter for database nova_cell1 Jul 12 18:16:13.428537 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO dbcounter [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] Registered counter for database nova_cell1 Jul 12 18:16:13.436437 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_db.sqlalchemy.engines [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:16:13.438622 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_db.sqlalchemy.engines [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:16:13.440153 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG oslo_db.sqlalchemy.engines [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:16:13.442014 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writer thread running {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:16:13.442342 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG oslo_db.sqlalchemy.engines [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:16:13.449515 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG dbcounter [-] [103852] Writer thread running {{(pid=103852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:16:13.582365 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writer thread running {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:16:13.589938 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG dbcounter [-] [103852] Writer thread running {{(pid=103852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:16:13.591899 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO dbcounter [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Registered counter for database nova_cell0 Jul 12 18:16:13.599932 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO dbcounter [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] Registered counter for database nova_cell0 Jul 12 18:16:13.600546 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_db.sqlalchemy.engines [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:16:13.605859 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writer thread running {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:16:13.609584 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG oslo_db.sqlalchemy.engines [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:16:13.613910 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG dbcounter [-] [103852] Writer thread running {{(pid=103852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:16:14.000947 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: WARNING keystonemiddleware.auth_token [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:16:14.008132 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: WARNING keystonemiddleware.auth_token [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:16:14.022492 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: WARNING keystonemiddleware.auth_token [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:16:14.030047 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: WARNING keystonemiddleware.auth_token [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:16:14.371463 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: WARNING keystonemiddleware.auth_token [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:16:14.381919 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: WARNING keystonemiddleware.auth_token [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:16:14.391943 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a1404959c0 pid: 103851 (default app) Jul 12 18:16:14.395319 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:16:14.397186 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002782 Jul 12 18:16:14.397815 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Tue Jul 12 18:16:14 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:16:14.402717 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: WARNING keystonemiddleware.auth_token [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:16:14.408798 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: WARNING keystonemiddleware.auth_token [None req-0405ee2a-5742-4846-9575-514c76e27745 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:16:14.413867 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a1404959c0 pid: 103852 (default app) Jul 12 18:17:35.533502 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:17:35.534503 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 12 18:17:35.534904 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:17:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:17:35.548078 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG dbcounter [-] [103852] Writing DB stats nova_api:SELECT=3 {{(pid=103852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:35.549631 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG dbcounter [-] [103852] Writing DB stats nova_cell0:SELECT=3 {{(pid=103852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:35.550623 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG dbcounter [-] [103852] Writing DB stats nova_cell1:SELECT=3 {{(pid=103852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:35.551450 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG dbcounter [-] [103852] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:36.493800 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-67ffcc40-b5c7-435d-b671-f5b00000d2f0 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:17:36.528445 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-67ffcc40-b5c7-435d-b671-f5b00000d2f0 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.985771 Jul 12 18:17:36.529328 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Tue Jul 12 18:17:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:17:38.796538 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:17:38.797610 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-340e16dc-b27b-4d23-8af6-1dde5d596598 None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 12 18:17:38.797924 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:17:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:17:39.306233 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-37ab7e13-adea-4fc4-b2e6-b3ea21de7477 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "ram": 256, "vcpus": 1}} {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:39.324821 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:39.324821 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: warnings.warn(msg) Jul 12 18:17:39.480811 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-37ab7e13-adea-4fc4-b2e6-b3ea21de7477 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.676169 Jul 12 18:17:39.481821 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Tue Jul 12 18:17:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:17:39.496257 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writing DB stats nova_api:SELECT=3 {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:39.497767 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writing DB stats nova_cell0:SELECT=3 {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:39.498775 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writing DB stats nova_cell1:SELECT=3 {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:39.499697 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:39.720925 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-c03a0a32-c41b-4e69-9479-97635ac4ba0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:39.723673 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:39.723673 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: warnings.warn(msg) Jul 12 18:17:39.842475 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-c03a0a32-c41b-4e69-9479-97635ac4ba0b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.351481 Jul 12 18:17:39.842475 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Tue Jul 12 18:17:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:17:42.165588 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-37ab7e13-adea-4fc4-b2e6-b3ea21de7477 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:17:42.166688 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-37ab7e13-adea-4fc4-b2e6-b3ea21de7477 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002374 Jul 12 18:17:42.167291 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:17:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:17:42.998532 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-9771f738-d472-4b59-ab91-2d5af800fccb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:43.016967 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:43.016967 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: warnings.warn(msg) Jul 12 18:17:43.149561 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-9771f738-d472-4b59-ab91-2d5af800fccb admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.976088 Jul 12 18:17:43.150304 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Tue Jul 12 18:17:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:17:43.162825 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-afec4f0b-c33d-4aaa-965a-6c4c3b9c510f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:43.165151 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:43.165151 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: warnings.warn(msg) Jul 12 18:17:43.272847 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-afec4f0b-c33d-4aaa-965a-6c4c3b9c510f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113555 Jul 12 18:17:43.281167 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Tue Jul 12 18:17:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:17:45.545282 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-9771f738-d472-4b59-ab91-2d5af800fccb admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:17:45.546307 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-9771f738-d472-4b59-ab91-2d5af800fccb admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 12 18:17:45.546694 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:17:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:17:45.967917 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-b154683f-23b4-49a4-a428-720f2db3059e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "name": "ds1G", "id": "d2"}} {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:46.062942 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-b154683f-23b4-49a4-a428-720f2db3059e admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510236 Jul 12 18:17:46.063486 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Tue Jul 12 18:17:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:17:46.076128 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-b3b3519b-20aa-4d62-b9a2-4e410d02992d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:46.169491 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-b3b3519b-20aa-4d62-b9a2-4e410d02992d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096881 Jul 12 18:17:46.170095 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Tue Jul 12 18:17:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:17:48.421785 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-b154683f-23b4-49a4-a428-720f2db3059e admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:17:48.423030 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-b154683f-23b4-49a4-a428-720f2db3059e admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jul 12 18:17:48.423532 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:17:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:17:48.891912 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-df792f84-81f5-457c-a09c-9bc2ea755e58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:48.972202 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-df792f84-81f5-457c-a09c-9bc2ea755e58 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.542230 Jul 12 18:17:48.981121 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Tue Jul 12 18:17:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:17:48.986411 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-f0a919a5-f6a9-4bd5-b50e-5ce3f5332d37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:49.078615 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-f0a919a5-f6a9-4bd5-b50e-5ce3f5332d37 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096072 Jul 12 18:17:49.082463 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Tue Jul 12 18:17:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:17:51.387044 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-df792f84-81f5-457c-a09c-9bc2ea755e58 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:17:51.388050 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-df792f84-81f5-457c-a09c-9bc2ea755e58 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 12 18:17:51.388481 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:17:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:17:51.858178 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-4ff13da2-b084-46f8-8c3b-c930e6a88a5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "disk": 20, "vcpus": 4}} {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:51.953434 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-4ff13da2-b084-46f8-8c3b-c930e6a88a5b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.558277 Jul 12 18:17:51.954379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Tue Jul 12 18:17:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:17:51.967132 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-585debf7-179a-4c55-8f38-71bca1247757 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:52.099119 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-585debf7-179a-4c55-8f38-71bca1247757 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131503 Jul 12 18:17:52.099119 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Tue Jul 12 18:17:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:17:54.626127 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-4ff13da2-b084-46f8-8c3b-c930e6a88a5b admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:17:54.627141 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-4ff13da2-b084-46f8-8c3b-c930e6a88a5b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 12 18:17:54.627544 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:17:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:17:55.089020 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-ba932e30-eba0-413a-95e6-f92f3b44e7eb admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:17:55.113121 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-ba932e30-eba0-413a-95e6-f92f3b44e7eb admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.476665 Jul 12 18:17:55.113631 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Tue Jul 12 18:17:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:17:57.928684 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-4ff13da2-b084-46f8-8c3b-c930e6a88a5b admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:17:57.930180 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-4ff13da2-b084-46f8-8c3b-c930e6a88a5b admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Jul 12 18:17:57.930635 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:17:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:17:58.402227 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-173ff710-698d-4cca-a0ea-5d9a0989ce19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "swap": 0}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:58.502603 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-173ff710-698d-4cca-a0ea-5d9a0989ce19 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.563142 Jul 12 18:17:58.503164 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Tue Jul 12 18:17:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:17:58.516559 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-8e6d6b93-533e-4a14-b6b4-32ff9da05374 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:17:58.580841 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-8e6d6b93-533e-4a14-b6b4-32ff9da05374 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067788 Jul 12 18:17:58.581349 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Tue Jul 12 18:17:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:18:00.851829 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-173ff710-698d-4cca-a0ea-5d9a0989ce19 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:00.853727 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-173ff710-698d-4cca-a0ea-5d9a0989ce19 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002898 Jul 12 18:18:00.854332 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:18:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:01.307279 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-edfdc4d2-d648-4708-9b9d-c8f2f0be91ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "id": "2"}} {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:01.535766 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-edfdc4d2-d648-4708-9b9d-c8f2f0be91ac admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.674370 Jul 12 18:18:01.536235 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Tue Jul 12 18:18:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:18:01.548942 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-6625dce1-12e3-425c-95a7-3c1b0df63a27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:01.677443 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-6625dce1-12e3-425c-95a7-3c1b0df63a27 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132217 Jul 12 18:18:01.678243 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Tue Jul 12 18:18:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:18:03.976085 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-edfdc4d2-d648-4708-9b9d-c8f2f0be91ac admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:03.977161 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-edfdc4d2-d648-4708-9b9d-c8f2f0be91ac admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Jul 12 18:18:03.977561 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:18:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:04.432463 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-324cf3ee-6b8d-4f27-9bec-f71720010691 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium"}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:04.508960 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-324cf3ee-6b8d-4f27-9bec-f71720010691 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.525321 Jul 12 18:18:04.509514 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Tue Jul 12 18:18:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:18:04.526104 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-7e76a36f-6f27-4cf0-8503-21376a203955 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:04.642961 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-7e76a36f-6f27-4cf0-8503-21376a203955 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123162 Jul 12 18:18:04.644426 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Tue Jul 12 18:18:04 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:18:07.014156 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-324cf3ee-6b8d-4f27-9bec-f71720010691 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:07.015189 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-324cf3ee-6b8d-4f27-9bec-f71720010691 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Jul 12 18:18:07.015598 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:18:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:07.517014 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-796edf2b-412f-4cd7-a166-ac5e20adf251 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "disk": 80}} {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:07.522544 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG dbcounter [-] [103852] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:07.695007 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-796edf2b-412f-4cd7-a166-ac5e20adf251 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.672771 Jul 12 18:18:07.695760 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Tue Jul 12 18:18:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:18:07.707792 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-2d7cd5c5-0e40-4f95-a479-f732507a85cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:07.792429 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-2d7cd5c5-0e40-4f95-a479-f732507a85cd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088360 Jul 12 18:18:07.793210 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Tue Jul 12 18:18:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:18:10.051728 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-796edf2b-412f-4cd7-a166-ac5e20adf251 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:10.052820 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-796edf2b-412f-4cd7-a166-ac5e20adf251 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Jul 12 18:18:10.053706 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:10.529209 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-9620c103-3633-49f2-aa4a-03c0aac05297 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "5", "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:10.602979 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-9620c103-3633-49f2-aa4a-03c0aac05297 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.543329 Jul 12 18:18:10.610904 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Tue Jul 12 18:18:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:18:10.616379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-8d624834-b1c7-4bf9-8990-4e570482ff50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:10.700324 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-8d624834-b1c7-4bf9-8990-4e570482ff50 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088185 Jul 12 18:18:10.700984 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Tue Jul 12 18:18:10 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:18:30.229149 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-9620c103-3633-49f2-aa4a-03c0aac05297 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:30.230495 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-9620c103-3633-49f2-aa4a-03c0aac05297 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 12 18:18:30.230824 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:18:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:30.627297 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-73c50584-1854-4443-98ad-163cae0403fc admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:30.643860 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-73c50584-1854-4443-98ad-163cae0403fc admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407125 Jul 12 18:18:30.644467 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Tue Jul 12 18:18:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:18:31.735172 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-9620c103-3633-49f2-aa4a-03c0aac05297 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:31.736161 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-9620c103-3633-49f2-aa4a-03c0aac05297 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 12 18:18:31.736598 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:32.277700 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-2929005a-3460-4345-9391-fb549102e0cc admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:32.283265 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.wsgi [None req-2929005a-3460-4345-9391-fb549102e0cc admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-2929005a-3460-4345-9391-fb549102e0cc admin admin] Request method failure captured: Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Accept: application/json Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Accept-Encoding: gzip, deflate Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Connection: keep-alive Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Content-Length: 0 Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Host: 10.222.0.47 Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Openstack-Api-Version: compute 2.90 Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Openstack-System-Scope: None Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: User-Agent: python-novaclient Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Auth-Token: gAAAAABizbr3XgkA-aEStPbuqNqkBoG9ZOFVQBz5A8icDNPTjYlTVXiztXbvKVG43g6A_I4UvVYDFjo9y8d0tktNhjf8JyiWOh7AYyw2xhh4G8npGdXXezO9nDeU0euX3WcB3NVvyt6R4ekjhst4CjEc0Gu27i8LYMSSSTwc2vnOUVICwoTFL0Q Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Domain-Id: None Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Domain-Name: None Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Identity-Status: Confirmed Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Is-Admin-Project: True Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Domain-Id: default Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Domain-Name: Default Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Name: admin Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Role: admin,member,reader Jul 12 18:18:32.286506 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Roles: admin,member,reader Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cecdefe3d592442ba46417c3dd5f54f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Tenant: admin Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Tenant-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Tenant-Name: admin Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User: admin Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Domain-Id: default Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Domain-Name: Default Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Id: 26ab52b942da412ea520d26ff61916e1 Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Name: admin Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: method: > Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: exception: Flavor 42 could not be found. Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: action_args: {'id': '42'} Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:18:32.288135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:32.289310 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:32.290716 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-2929005a-3460-4345-9391-fb549102e0cc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:18:32.291881 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-2929005a-3460-4345-9391-fb549102e0cc admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.407185 Jul 12 18:18:32.291881 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Jul 12 18:18:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 18:18:32.298003 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-e8dc14d9-a80e-4a23-975f-d341e035865f admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:32.301012 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:32.321851 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-e8dc14d9-a80e-4a23-975f-d341e035865f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027664 Jul 12 18:18:32.322408 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Jul 12 18:18:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:18:32.332460 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-bee64e85-db56-42d5-9058-3e8dcf6f0214 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:32.353444 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-bee64e85-db56-42d5-9058-3e8dcf6f0214 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024517 Jul 12 18:18:32.353986 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Jul 12 18:18:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:18:32.364099 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-157c4781-f98e-4b90-a905-7d5882edcdf2 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:32.370480 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.wsgi [None req-157c4781-f98e-4b90-a905-7d5882edcdf2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-157c4781-f98e-4b90-a905-7d5882edcdf2 admin admin] Request method failure captured: Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Accept: application/json Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Accept-Encoding: gzip, deflate Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Connection: keep-alive Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Content-Length: 0 Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Host: 10.222.0.47 Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Openstack-Api-Version: compute 2.90 Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Openstack-System-Scope: None Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: User-Agent: python-novaclient Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Auth-Token: gAAAAABizbr3XgkA-aEStPbuqNqkBoG9ZOFVQBz5A8icDNPTjYlTVXiztXbvKVG43g6A_I4UvVYDFjo9y8d0tktNhjf8JyiWOh7AYyw2xhh4G8npGdXXezO9nDeU0euX3WcB3NVvyt6R4ekjhst4CjEc0Gu27i8LYMSSSTwc2vnOUVICwoTFL0Q Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Domain-Id: None Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Domain-Name: None Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Identity-Status: Confirmed Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Is-Admin-Project: True Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Domain-Id: default Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Domain-Name: Default Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Name: admin Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Role: admin,member,reader Jul 12 18:18:32.373968 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Roles: admin,member,reader Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cecdefe3d592442ba46417c3dd5f54f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Tenant: admin Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Tenant-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Tenant-Name: admin Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User: admin Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Domain-Id: default Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Domain-Name: Default Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Id: 26ab52b942da412ea520d26ff61916e1 Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Name: admin Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: method: > Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: exception: Flavor 42 could not be found. Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: action_args: {'id': '42'} Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:18:32.375593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:32.378501 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:32.379844 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-157c4781-f98e-4b90-a905-7d5882edcdf2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:18:32.381128 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-157c4781-f98e-4b90-a905-7d5882edcdf2 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015140 Jul 12 18:18:32.381128 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Jul 12 18:18:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 18:18:33.353870 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-bee64e85-db56-42d5-9058-3e8dcf6f0214 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:33.354932 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-bee64e85-db56-42d5-9058-3e8dcf6f0214 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 12 18:18:33.355580 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:33.882659 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-6ea58cef-4686-4f7d-bfe4-2d8bf891330d admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:33.888489 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.wsgi [None req-6ea58cef-4686-4f7d-bfe4-2d8bf891330d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-6ea58cef-4686-4f7d-bfe4-2d8bf891330d admin admin] Request method failure captured: Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Accept: application/json Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Accept-Encoding: gzip, deflate Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Connection: keep-alive Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Content-Length: 0 Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Host: 10.222.0.47 Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Openstack-Api-Version: compute 2.90 Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Openstack-System-Scope: None Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: User-Agent: python-novaclient Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Auth-Token: gAAAAABizbr5IlZDaHCiNrJem45-zJpSX6Ygv4wgxP3_jf4-Bz1fjNkS3ZU7T7CzRec1OmMf4Nv9YueGNOOLIROPFktPPnUuuVL7LkJI2WZaAkPkCW_CHM12Swp00Z7jVrAZqu7CyO4cZwydGPf8C8sDtNUcw_8jYhl8uxJN1wNssXdjJr4TTiA Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Domain-Id: None Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Domain-Name: None Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Identity-Status: Confirmed Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Is-Admin-Project: True Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Domain-Id: default Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Domain-Name: Default Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Name: admin Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Role: admin,member,reader Jul 12 18:18:33.890016 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Roles: admin,member,reader Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cecdefe3d592442ba46417c3dd5f54f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Tenant: admin Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Tenant-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Tenant-Name: admin Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User: admin Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Domain-Id: default Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Domain-Name: Default Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Id: 26ab52b942da412ea520d26ff61916e1 Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Name: admin Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: method: > Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: exception: Flavor 84 could not be found. Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: action_args: {'id': '84'} Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:18:33.891593 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:33.892565 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:33.893674 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-6ea58cef-4686-4f7d-bfe4-2d8bf891330d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:18:33.894830 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-6ea58cef-4686-4f7d-bfe4-2d8bf891330d admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397638 Jul 12 18:18:33.894830 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Jul 12 18:18:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 18:18:33.901728 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-27ef84a7-fd6f-44e4-ab0d-61c0fbc92fb3 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:33.915222 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-27ef84a7-fd6f-44e4-ab0d-61c0fbc92fb3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017436 Jul 12 18:18:33.916439 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Jul 12 18:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:18:33.925708 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-2f620fdf-eb6d-4e92-ba91-4123c6c61959 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:33.939479 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-2f620fdf-eb6d-4e92-ba91-4123c6c61959 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017231 Jul 12 18:18:33.939998 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Jul 12 18:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:18:33.949688 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-7478446f-a4f6-4abe-bd0d-cc1b6fc4f225 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:33.955284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.wsgi [None req-7478446f-a4f6-4abe-bd0d-cc1b6fc4f225 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-7478446f-a4f6-4abe-bd0d-cc1b6fc4f225 admin admin] Request method failure captured: Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Accept: application/json Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Accept-Encoding: gzip, deflate Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Connection: keep-alive Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Content-Length: 0 Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Host: 10.222.0.47 Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Openstack-Api-Version: compute 2.90 Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Openstack-System-Scope: None Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: User-Agent: python-novaclient Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Auth-Token: gAAAAABizbr5IlZDaHCiNrJem45-zJpSX6Ygv4wgxP3_jf4-Bz1fjNkS3ZU7T7CzRec1OmMf4Nv9YueGNOOLIROPFktPPnUuuVL7LkJI2WZaAkPkCW_CHM12Swp00Z7jVrAZqu7CyO4cZwydGPf8C8sDtNUcw_8jYhl8uxJN1wNssXdjJr4TTiA Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Domain-Id: None Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Domain-Name: None Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Identity-Status: Confirmed Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Is-Admin-Project: True Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Domain-Id: default Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Domain-Name: Default Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Name: admin Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Role: admin,member,reader Jul 12 18:18:33.956818 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Roles: admin,member,reader Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cecdefe3d592442ba46417c3dd5f54f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Tenant: admin Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Tenant-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Tenant-Name: admin Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User: admin Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Domain-Id: default Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Domain-Name: Default Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Id: 26ab52b942da412ea520d26ff61916e1 Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Name: admin Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: method: > Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: exception: Flavor 84 could not be found. Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: action_args: {'id': '84'} Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:18:33.958417 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:33.959408 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:33.960742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-7478446f-a4f6-4abe-bd0d-cc1b6fc4f225 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:18:33.961950 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-7478446f-a4f6-4abe-bd0d-cc1b6fc4f225 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012558 Jul 12 18:18:33.961950 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Tue Jul 12 18:18:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 18:18:34.934385 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-2f620fdf-eb6d-4e92-ba91-4123c6c61959 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:34.935396 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-2f620fdf-eb6d-4e92-ba91-4123c6c61959 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 12 18:18:34.935766 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:18:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:35.464993 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-252a69cf-18c3-4035-af2f-32ebb69641a5 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:35.470793 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.wsgi [None req-252a69cf-18c3-4035-af2f-32ebb69641a5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-252a69cf-18c3-4035-af2f-32ebb69641a5 admin admin] Request method failure captured: Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Accept: application/json Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Accept-Encoding: gzip, deflate Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Connection: keep-alive Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Content-Length: 0 Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Host: 10.222.0.47 Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Openstack-Api-Version: compute 2.90 Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Openstack-System-Scope: None Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: User-Agent: python-novaclient Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Auth-Token: gAAAAABizbr6YhozTVGEFE_NzpE68PIIUINA1fYZ4c1H8XUHkdJDXi5sDmMcTpe3KfNYfY0SESBKKFabesNrhKu1MXP0IvdI4xCTpC_ewbVGUEn1oZb7AM-kFxS0IN6p_WzHDP6D0-c1WX375VoD7QhFfteYvs9yDosak-H83uJInIwHN00RfJk Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Domain-Id: None Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Domain-Name: None Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Identity-Status: Confirmed Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Is-Admin-Project: True Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Domain-Id: default Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Domain-Name: Default Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Project-Name: admin Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Role: admin,member,reader Jul 12 18:18:35.472284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Roles: admin,member,reader Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cecdefe3d592442ba46417c3dd5f54f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Tenant: admin Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Tenant-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-Tenant-Name: admin Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User: admin Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Domain-Id: default Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Domain-Name: Default Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Id: 26ab52b942da412ea520d26ff61916e1 Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: X-User-Name: admin Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: method: > Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: exception: Flavor 451 could not be found. Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: action_args: {'id': '451'} Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:18:35.473571 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:35.474379 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: ERROR nova.api.openstack.wsgi Jul 12 18:18:35.475462 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-252a69cf-18c3-4035-af2f-32ebb69641a5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:18:35.476654 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-252a69cf-18c3-4035-af2f-32ebb69641a5 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.400235 Jul 12 18:18:35.476654 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Jul 12 18:18:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 18:18:35.484040 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-0caba10e-0cc1-4b0e-bd08-b2ab663bb579 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:35.498447 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-0caba10e-0cc1-4b0e-bd08-b2ab663bb579 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018212 Jul 12 18:18:35.498971 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Jul 12 18:18:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:18:35.508411 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:35.523299 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018445 Jul 12 18:18:35.523839 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Tue Jul 12 18:18:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:18:35.533422 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-16e92fe9-c086-4dfc-8ab5-8cd4cf92ead4 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:35.538940 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.wsgi [None req-16e92fe9-c086-4dfc-8ab5-8cd4cf92ead4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-16e92fe9-c086-4dfc-8ab5-8cd4cf92ead4 admin admin] Request method failure captured: Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Accept: application/json Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Accept-Encoding: gzip, deflate Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Connection: keep-alive Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Content-Length: 0 Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Host: 10.222.0.47 Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Openstack-Api-Version: compute 2.90 Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Openstack-System-Scope: None Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: User-Agent: python-novaclient Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Auth-Token: gAAAAABizbr6YhozTVGEFE_NzpE68PIIUINA1fYZ4c1H8XUHkdJDXi5sDmMcTpe3KfNYfY0SESBKKFabesNrhKu1MXP0IvdI4xCTpC_ewbVGUEn1oZb7AM-kFxS0IN6p_WzHDP6D0-c1WX375VoD7QhFfteYvs9yDosak-H83uJInIwHN00RfJk Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Domain-Id: None Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Domain-Name: None Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Identity-Status: Confirmed Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Is-Admin-Project: True Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Domain-Id: default Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Domain-Name: Default Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Project-Name: admin Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Role: admin,member,reader Jul 12 18:18:35.541061 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Roles: admin,member,reader Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cecdefe3d592442ba46417c3dd5f54f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cecdefe3d592442ba46417c3dd5f54f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Tenant: admin Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Tenant-Id: cecdefe3d592442ba46417c3dd5f54f9 Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-Tenant-Name: admin Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User: admin Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Domain-Id: default Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Domain-Name: Default Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Id: 26ab52b942da412ea520d26ff61916e1 Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: X-User-Name: admin Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: method: > Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: exception: Flavor 451 could not be found. Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: action_args: {'id': '451'} Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:18:35.542686 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:35.543728 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: ERROR nova.api.openstack.wsgi Jul 12 18:18:35.545002 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-16e92fe9-c086-4dfc-8ab5-8cd4cf92ead4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:18:35.546250 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-16e92fe9-c086-4dfc-8ab5-8cd4cf92ead4 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012558 Jul 12 18:18:35.546250 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Jul 12 18:18:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 18:18:36.530753 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:36.531758 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 12 18:18:36.532150 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:37.054614 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-d0e0ddb7-46d5-4b4c-a6a2-7e0d6640040b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:37.129448 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-d0e0ddb7-46d5-4b4c-a6a2-7e0d6640040b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.459472 Jul 12 18:18:37.129984 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Tue Jul 12 18:18:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:18:38.116284 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:38.117341 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 12 18:18:38.117729 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:38.647894 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-bfd08277-1081-4504-bb4b-514192b07f28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:38.700632 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-bfd08277-1081-4504-bb4b-514192b07f28 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.445198 Jul 12 18:18:38.701185 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Tue Jul 12 18:18:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:18:39.688562 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:39.689782 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 12 18:18:39.689952 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:18:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:40.214781 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-61bd2d04-5735-4bf8-b118-65d8766bc92d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:40.283722 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-61bd2d04-5735-4bf8-b118-65d8766bc92d admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.456208 Jul 12 18:18:40.284256 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Tue Jul 12 18:18:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:18:41.372696 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:41.373741 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 12 18:18:41.374129 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:41.901431 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-999e59f9-3ea1-4c91-88c1-b92dd00c2e69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:18:41.999020 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-999e59f9-3ea1-4c91-88c1-b92dd00c2e69 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.487156 Jul 12 18:18:41.999494 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Tue Jul 12 18:18:41 2022] POST /compute/v2.1/flavors => generated 409 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:18:42.968718 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:42.969742 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 12 18:18:42.970124 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:18:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:18:43.492275 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-bf0ea7c6-8852-4175-8e54-73f37fc9d854 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:18:43.512140 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-bf0ea7c6-8852-4175-8e54-73f37fc9d854 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404114 Jul 12 18:18:43.512614 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Tue Jul 12 18:18:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:19:36.095865 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:19:36.096973 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-f3697eac-bde9-4ebc-8e6e-ed0c3f99fbd2 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 12 18:19:36.097368 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Tue Jul 12 18:19:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:19:36.108268 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:36.495915 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-0a4f250b-2ae5-4345-9756-57721571d5f0 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:19:36.515360 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-0a4f250b-2ae5-4345-9756-57721571d5f0 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411649 Jul 12 18:19:36.515813 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Tue Jul 12 18:19:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:19:36.536621 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG dbcounter [-] [103852] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:36.540433 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-0eaeb6f3-d92e-4176-b0b5-3c2479300ba7 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:19:36.547905 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-0eaeb6f3-d92e-4176-b0b5-3c2479300ba7 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012715 Jul 12 18:19:36.551216 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Tue Jul 12 18:19:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:19:36.560422 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-e154735d-9a1e-40cf-a4a7-adbc025cf02b admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:19:36.567971 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-e154735d-9a1e-40cf-a4a7-adbc025cf02b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011177 Jul 12 18:19:36.568509 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Tue Jul 12 18:19:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:19:36.580280 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-df86bc92-1d43-4d95-a263-c137489917d0 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:19:36.588245 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-df86bc92-1d43-4d95-a263-c137489917d0 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011458 Jul 12 18:19:36.588791 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Tue Jul 12 18:19:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:19:36.599781 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-7022c32d-6640-465b-ac20-525c54d4d782 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:19:36.607603 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-7022c32d-6640-465b-ac20-525c54d4d782 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011359 Jul 12 18:19:36.608106 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Tue Jul 12 18:19:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:23:07.550108 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-df86bc92-1d43-4d95-a263-c137489917d0 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:23:07.551135 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-df86bc92-1d43-4d95-a263-c137489917d0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 12 18:23:07.551520 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:23:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:23:07.692804 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writing DB stats nova_api:SELECT=6 {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:07.854100 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-671c6185-7259-4116-b0bb-9479e1cde613 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:23:07.855560 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:07.855560 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: warnings.warn(msg) Jul 12 18:23:07.856797 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-671c6185-7259-4116-b0bb-9479e1cde613 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:23:07.857271 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-671c6185-7259-4116-b0bb-9479e1cde613 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:23:07.858052 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-671c6185-7259-4116-b0bb-9479e1cde613 admin admin] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:23:07.858475 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-671c6185-7259-4116-b0bb-9479e1cde613 admin admin] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:23:07.891314 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-671c6185-7259-4116-b0bb-9479e1cde613 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199946 Jul 12 18:23:07.891882 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Jul 12 18:23:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:23:08.719370 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-df86bc92-1d43-4d95-a263-c137489917d0 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:23:08.720422 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-df86bc92-1d43-4d95-a263-c137489917d0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jul 12 18:23:08.721401 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:23:08.913192 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-62a01a50-eca9-4444-83ba-61566d8b8896 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:23:08.914370 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:08.914370 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: warnings.warn(msg) Jul 12 18:23:08.915540 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-62a01a50-eca9-4444-83ba-61566d8b8896 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:23:08.915979 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-62a01a50-eca9-4444-83ba-61566d8b8896 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:23:08.916810 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-62a01a50-eca9-4444-83ba-61566d8b8896 admin admin] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:23:08.917232 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-62a01a50-eca9-4444-83ba-61566d8b8896 admin admin] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:23:08.937197 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-62a01a50-eca9-4444-83ba-61566d8b8896 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077133 Jul 12 18:23:08.937742 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Jul 12 18:23:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:23:20.232860 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-df86bc92-1d43-4d95-a263-c137489917d0 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:23:20.233854 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-df86bc92-1d43-4d95-a263-c137489917d0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 12 18:23:20.234238 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:23:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:23:20.377999 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writing DB stats nova_cell0:SELECT=4 {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:20.378636 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writing DB stats nova_cell1:SELECT=4 {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:20.379252 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG dbcounter [-] [103851] Writing DB stats nova_api:SELECT=8 {{(pid=103851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:20.428182 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-9c6aed4c-7c8b-4068-ba3e-1775c94be660 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:23:20.429400 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:20.429400 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: warnings.warn(msg) Jul 12 18:23:20.430690 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-9c6aed4c-7c8b-4068-ba3e-1775c94be660 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:23:20.431121 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-9c6aed4c-7c8b-4068-ba3e-1775c94be660 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:23:20.431899 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-9c6aed4c-7c8b-4068-ba3e-1775c94be660 admin admin] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:23:20.432370 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-9c6aed4c-7c8b-4068-ba3e-1775c94be660 admin admin] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:23:20.459547 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-9c6aed4c-7c8b-4068-ba3e-1775c94be660 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086506 Jul 12 18:23:20.461962 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Jul 12 18:23:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:23:21.296567 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: DEBUG nova.api.openstack.wsgi [None req-df86bc92-1d43-4d95-a263-c137489917d0 admin admin] Calling method '>' {{(pid=103852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:23:21.297585 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: INFO nova.api.openstack.requestlog [None req-df86bc92-1d43-4d95-a263-c137489917d0 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 12 18:23:21.298313 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: [pid: 103852|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Tue Jul 12 18:23:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:23:21.493360 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG nova.api.openstack.wsgi [None req-21c19e3c-f49a-4d18-96b3-5fef609a91f0 admin admin] Calling method '>' {{(pid=103851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:23:21.494524 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:23:21.494524 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: warnings.warn(msg) Jul 12 18:23:21.495707 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-21c19e3c-f49a-4d18-96b3-5fef609a91f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:23:21.496139 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-21c19e3c-f49a-4d18-96b3-5fef609a91f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:23:21.496955 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-21c19e3c-f49a-4d18-96b3-5fef609a91f0 admin admin] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:23:21.497376 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: DEBUG oslo_concurrency.lockutils [None req-21c19e3c-f49a-4d18-96b3-5fef609a91f0 admin admin] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:23:21.519215 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: INFO nova.api.openstack.requestlog [None req-21c19e3c-f49a-4d18-96b3-5fef609a91f0 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079309 Jul 12 18:23:21.519691 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: [pid: 103851|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Tue Jul 12 18:23:21 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:24:16.044281 dv-cinder-844881-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 18:24:16.045235 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: Tue Jul 12 18:24:16 2022 - graceful shutdown triggered... Jul 12 18:24:16.045739 dv-cinder-844881-1-iscsi devstack@n-api.service[103852]: Gracefully killing worker 2 (pid: 103852)... Jul 12 18:24:16.046104 dv-cinder-844881-1-iscsi devstack@n-api.service[103851]: Gracefully killing worker 1 (pid: 103851)... Jul 12 18:24:17.046383 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: worker 1 buried after 1 seconds Jul 12 18:24:17.047026 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: worker 2 buried after 1 seconds Jul 12 18:24:17.047026 dv-cinder-844881-1-iscsi devstack@n-api.service[103850]: goodbye to uWSGI. Jul 12 18:24:17.048000 dv-cinder-844881-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 18:24:17.048586 dv-cinder-844881-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 18:24:17.051391 dv-cinder-844881-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 18:24:17.061245 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 18:24:17.063858 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 18:24:17 2022] *** Jul 12 18:24:17.064016 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 18:24:17.064144 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 18:24:17.064248 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: nodename: dv-cinder-844881-1-iscsi Jul 12 18:24:17.064379 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: machine: x86_64 Jul 12 18:24:17.064512 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: clock source: unix Jul 12 18:24:17.064626 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: pcre jit disabled Jul 12 18:24:17.064728 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: detected number of CPU cores: 4 Jul 12 18:24:17.064826 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: current working directory: / Jul 12 18:24:17.064933 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: detected binary path: /usr/bin/uwsgi-core Jul 12 18:24:17.065052 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: your processes number limit is 47680 Jul 12 18:24:17.065165 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: your memory page size is 4096 bytes Jul 12 18:24:17.065287 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: detected max file descriptor number: 2048 Jul 12 18:24:17.065400 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: lock engine: pthread robust mutexes Jul 12 18:24:17.065681 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: thunder lock: enabled Jul 12 18:24:17.065997 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 18:24:17.066126 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 18:24:17.112183 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: Python main interpreter initialized at 0x55edfb2d59c0 Jul 12 18:24:17.112183 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: python threads support enabled Jul 12 18:24:17.112183 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: your server socket listen backlog is limited to 100 connections Jul 12 18:24:17.112183 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: your mercy for graceful operations on workers is 90 seconds Jul 12 18:24:17.112651 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 18:24:17.112726 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: *** Operational MODE: preforking *** Jul 12 18:24:17.112984 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: *** uWSGI is running in multiple interpreter mode *** Jul 12 18:24:17.112984 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: spawned uWSGI master process (pid: 118396) Jul 12 18:24:17.113196 dv-cinder-844881-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 18:24:17.115339 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: spawned uWSGI worker 1 (pid: 118410, cores: 1) Jul 12 18:24:17.115339 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: spawned uWSGI worker 2 (pid: 118411, cores: 1) Jul 12 18:24:17.115339 dv-cinder-844881-1-iscsi devstack@n-api.service[118396]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 18:24:17.785403 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 18:24:17.795195 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 18:24:19.003961 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:24:19.003961 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: from cryptography.utils import int_from_bytes Jul 12 18:24:19.004809 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:24:19.004809 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: from cryptography.utils import int_from_bytes Jul 12 18:24:19.004940 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:24:19.004940 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: from cryptography.utils import int_from_bytes Jul 12 18:24:19.004940 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:24:19.004940 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: from cryptography.utils import int_from_bytes Jul 12 18:24:21.381009 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:24:21.381570 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:24:21.381811 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:24:21.382172 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:24:21.383438 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:24:21.383438 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.383438 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.383438 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.384862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.384862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.385018 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.385354 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.385560 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.385888 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.386154 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.386472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.386803 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844881-1-iscsi {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.387130 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.387442 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.387756 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.388073 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.388408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.388740 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.389048 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.389557 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.390770 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:24:21.391207 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.391306 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:24:21.391381 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.391381 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.391523 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:24:21.391599 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.391683 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:24:21.391762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.391843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:24:21.391920 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.392009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.392088 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.392176 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.392253 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.392375 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.392693 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.392806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.392888 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.392969 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.393202 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844881-1-iscsi {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.393316 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.393515 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.393658 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.393841 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.393947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.394144 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.394263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.394463 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.394688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.394932 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.395179 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.395383 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844881-1-iscsi {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.395594 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.395714 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.395804 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.395878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.395963 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.396046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.396118 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.396300 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.396465 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.396606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.396736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.396879 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.397044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.397226 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.397378 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.397662 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.397791 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.397976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.398159 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.398302 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.398460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.398602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.398767 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.398901 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.399028 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.399208 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.399347 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.400439 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.400601 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.400750 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.400886 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.401018 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.401155 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.401285 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.401412 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.401547 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.401692 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.401834 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844881-1-iscsi {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.401971 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.402130 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.402253 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.402400 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.402529 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.402664 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.402808 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.403025 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.403171 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.403336 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.403476 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.403646 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.403779 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.403961 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.404180 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.404354 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.404498 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.404618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.404741 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.404890 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.405039 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.405199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.405340 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.405523 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.405710 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.405859 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.405999 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.406136 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.406276 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.406416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.406549 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.406726 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.406862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.407047 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.407207 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.407385 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.407692 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.407824 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.407943 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.408098 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.408220 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.408485 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.408603 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.421511 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.421723 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.422028 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.422133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.422221 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.422325 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.422420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.422518 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.422609 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.422701 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.422793 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.422887 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.422974 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.423065 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.423161 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.423264 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.423361 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.423452 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.423545 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.423635 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.423720 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.423807 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.423904 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.423995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.424086 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.424170 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.424258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.424373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.424469 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.424575 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.424682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.424768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.424915 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.425046 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.425148 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.425283 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.425378 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.425462 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.425568 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.425660 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.425660 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.425826 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.425909 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.425990 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426223 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426223 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426383 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426455 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426532 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426616 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426701 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426788 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426871 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.426953 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.427041 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.427138 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.427223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.427305 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.427393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.427514 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.427614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.427706 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.427804 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.427897 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.427990 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.428080 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.428163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.428163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.428852 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.428852 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.429045 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.429131 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.429237 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.429329 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.429427 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.429519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.429621 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.429701 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.429783 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.429865 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.429957 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.430057 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.430143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.430233 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.430316 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.430405 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.430887 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431013 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431109 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431205 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431286 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431357 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431435 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431595 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431665 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.431915 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.432001 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.432229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.432349 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.432439 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.432608 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.432608 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.432608 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.433012 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.433129 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.433246 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.433346 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.433442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.433535 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.433621 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.433703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.433794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.433884 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.433976 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.434048 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.434138 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.434230 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.434323 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.434407 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.434488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.434577 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.434670 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.434762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.434853 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.434938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.435020 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.435101 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.435101 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.435270 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.435353 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.435494 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.435590 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.435682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.435779 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.435779 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.435941 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.436024 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.436112 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.436200 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.436200 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.436448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.436547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.436667 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.436762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.436938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.437027 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.437109 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.437199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.437199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.437351 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.437443 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.437534 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.437626 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.437710 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.437798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.437891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.437986 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.438078 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.438161 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.438251 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.438358 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.438466 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.438737 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.439172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.439281 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.439368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.439451 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.439553 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.439638 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.439785 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.439887 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.439980 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:24:21.440115 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.440219 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.440332 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.440438 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.440526 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.440609 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.441380 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.441477 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.441565 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.441639 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.441710 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.441788 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.441867 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.441946 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442112 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442184 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442323 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442471 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442549 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442621 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442691 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442775 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.442933 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443011 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443152 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443221 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443304 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443405 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443478 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443558 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443629 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443699 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443782 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443868 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.443949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.444026 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.444097 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.444174 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.444254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.444373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.444449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.444518 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.444747 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.444835 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.444918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.444990 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.445069 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.445149 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.445149 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.445311 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.445397 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.445470 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.445945 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.446052 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.446127 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.446835 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.446932 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.447007 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.447109 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.447198 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.447472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.447581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.447836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.447975 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.448081 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.448249 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.448426 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.448594 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.448741 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.448926 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.449434 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.449510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.449597 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.449669 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.449739 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.449847 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.449942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.453236 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.454046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.454288 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.454393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.454483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.454567 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.454664 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.454758 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.454843 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.454921 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.455010 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.455102 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.455203 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.455290 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.455371 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.455462 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.455552 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.455646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.455738 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.455829 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.455958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.456051 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.456135 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.456233 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.456233 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.466088 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.466088 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.466488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.466659 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.466778 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.466867 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.466959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.467047 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.467134 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.467265 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.467581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.467694 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.467789 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.467881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.467974 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.468068 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.468160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.468253 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.468387 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.468476 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.468581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.468581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.468581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.468581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.468905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.468990 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.469072 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.469164 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.469249 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.469362 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.469472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.469579 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.469664 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.469830 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.469918 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.470011 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.470096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.470175 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.470265 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.470350 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.470438 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.470530 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.470620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.470620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.470620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.471294 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.471398 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.471484 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.471484 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.471645 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.471739 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.471824 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.471907 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.472033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.472125 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.472216 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.472330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.472428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.472515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.472623 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.472710 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.472802 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.473042 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.473143 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.473229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.473312 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.473393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.473393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.473393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.473393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.474036 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.474124 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.474124 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.474297 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.474389 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.474480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.474480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.474649 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.474649 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.474856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.474949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.475033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.475126 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.475217 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.475329 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.475414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.475504 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.475587 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.475678 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.475768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.475860 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.475951 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.476035 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.476035 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.476201 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.476284 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.476404 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.476491 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.476591 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.476682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.476765 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.476847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.476938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.477023 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.477023 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.477159 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.477241 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.477509 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.477689 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.477689 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.477975 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.478356 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.478518 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.478616 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.478710 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.478795 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.478885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.478976 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.479067 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.479165 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.479249 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.479340 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.479424 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.479515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.479859 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.479964 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.480057 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.480149 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.480238 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.480382 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.480469 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.480594 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.480688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.480781 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.480892 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.481348 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.481457 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.481545 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.481628 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.481719 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.481809 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.481901 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.481993 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.482086 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.482170 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.482253 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.482335 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.482418 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.482515 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.482600 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.482689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.482780 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.482937 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.483031 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.483130 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.483223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.483223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.483385 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.483471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.483567 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.483652 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.483741 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.483849 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484135 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484215 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484288 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484288 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484716 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484858 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.484858 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.485008 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.485257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.485501 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.485625 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.485859 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.485956 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.486165 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.486278 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.486481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.486585 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.486798 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.486891 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.487109 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.487211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.487417 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.487547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.487724 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.487878 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.488038 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.488343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.488456 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.488665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.488767 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.488970 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.489071 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.489280 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.489382 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.489603 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.489706 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.489969 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.490062 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.490290 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.490395 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.490618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.490718 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.490945 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.491039 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.491254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.491539 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.491637 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.491870 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.492257 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.492536 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.492754 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.492877 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.493133 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.493293 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.493635 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.493825 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.493987 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.494166 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.494533 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.494632 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.494860 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.494959 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.495175 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.495266 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.495502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.495592 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.495830 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.496146 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.496227 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.496691 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.496802 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.497093 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.497296 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.497587 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.497908 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.498223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.498538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.498851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.499163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.499476 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.499802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.500113 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.500525 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.500677 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.500837 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.501149 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.501403 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.501531 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.501851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.502340 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.502678 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.502993 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.503087 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.503313 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.503613 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.503719 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.503938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.504270 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.504445 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.504670 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.504931 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.505042 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.505256 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.505566 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.505921 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.506186 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.506318 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.506490 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.506794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.506902 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.507225 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.507404 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.507505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.507723 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.508017 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.508130 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.508377 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.508646 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.509274 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.509480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.509792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.509936 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.510104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.510541 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.510658 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.510821 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.511068 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.511172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.511445 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.511665 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.511810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.512077 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.512273 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.512413 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.512706 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.513013 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.513193 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.513357 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.513690 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.513830 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.514035 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.514296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.514401 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.514638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.514890 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.515012 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.515261 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.515508 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.515614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.515856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.516109 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.516206 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.516491 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.516723 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.516839 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.517102 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.517384 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.517494 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.517707 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.517927 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.518030 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.518305 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.519957 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.520088 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.520188 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.520291 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.520418 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.520505 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.520638 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.520734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.520734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.520911 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.521009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.521009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.521009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.521243 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.521329 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.521329 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.521964 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.522121 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.522223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.522223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.523193 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.523322 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.523322 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.523485 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.523578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.523578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.523845 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.523937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.523937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.524368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.525092 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.526405 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.526541 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.526644 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.526739 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.526836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.526929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.527060 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.527060 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.527060 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.527330 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.527472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.527568 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.528180 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.528292 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.528447 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.528538 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.528674 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.528768 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.529523 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.529637 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.529726 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.529821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.529916 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.529916 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.530479 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.530596 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.530685 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.530771 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.530771 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.531098 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.531282 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.531399 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.531699 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.531888 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.531995 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.532498 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.532671 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.532775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.532968 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.533420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.533534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.533748 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.533938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.534178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.534296 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.534559 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.534796 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.534917 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.535169 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.535392 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.535500 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.535784 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.536085 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.536208 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.536418 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.536724 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.536833 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.537032 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.537340 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.537437 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.537654 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.537929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.538046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.538276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.538558 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.538665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.538909 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.539118 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.539216 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.539511 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.539730 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.539876 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.540275 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.540392 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.540680 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.540914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.541076 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.541287 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.541429 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.541597 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.541888 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.542053 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.542217 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.542410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.542568 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.542792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.542933 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.543124 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.543400 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.543648 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.543752 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.544005 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.544248 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.544395 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.544629 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.544864 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.544960 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.545224 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.545434 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.545539 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.545823 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.546030 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.546271 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.546541 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.546683 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.546885 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.547131 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.547233 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.547488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.547738 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.547842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.548100 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.548368 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.548477 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.548725 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.548968 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.549141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.549481 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.549587 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.549920 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.550074 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.550237 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.550539 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.550652 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.550842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.551151 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.551290 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.551474 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.551749 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.551845 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.552087 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.552370 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.552482 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.552702 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.552977 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.553074 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.553314 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.553592 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.553708 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.554023 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.554178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.554378 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.554709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.554812 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.555037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.555277 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.555382 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.555678 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.556001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.556228 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.556641 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.556641 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.556904 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.557009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.557240 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.557494 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.557603 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.557880 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.558087 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.558202 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.558490 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.558690 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.558795 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.559100 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.559331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.559426 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.559722 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.559919 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.560044 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.560484 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.560618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.560815 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.561097 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.561203 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.561434 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.561697 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.561792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.562067 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.562299 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.562419 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.562656 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.562898 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.562999 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.563254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.563492 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.563637 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.563867 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.564107 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.564203 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.564491 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.564705 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.564819 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.565090 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.565312 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.565415 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.565697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.565905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.566013 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.566309 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.566516 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.566625 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.566938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.567098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.567255 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.567717 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.568095 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.568172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.568298 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.568444 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.568725 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.568821 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.568999 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.569103 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.569421 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.569605 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.569727 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.570047 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.570217 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.570379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.570709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.570812 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.571022 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.571875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.571989 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.572232 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.572539 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.572655 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.572991 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.573135 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.573231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.573453 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.573732 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.573870 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.574126 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.574330 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.574436 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.574634 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.574940 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.575041 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.575249 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.575534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.575642 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.575841 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.576135 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.576228 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.576500 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.576757 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.576889 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.577123 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.579183 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.579183 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.579183 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.579475 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.579585 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.579585 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.579759 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.579854 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.579947 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.580044 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.580044 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.580044 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.580276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.580490 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.580651 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.580815 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.581131 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.581403 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.581509 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.581746 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.582006 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.582111 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.582362 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.582606 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.582713 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.582977 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.583238 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.583502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.583620 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.584003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.584379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.584379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.584648 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.584826 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.584923 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.585163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.585452 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.585589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.585779 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.586067 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.586163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.586394 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.586661 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.586763 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.587719 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.587945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.588061 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.588156 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.588495 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.588697 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.589065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.589175 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.589309 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.589450 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.589792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.589896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.590169 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.590432 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.590719 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.590883 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.591045 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.591263 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.591408 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.591645 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.591740 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.592108 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.592274 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.592646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.592748 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.592837 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.593021 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.593259 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.593503 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.593611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.593951 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.594056 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.594181 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.594485 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.594686 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.594784 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.595090 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.595281 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.595404 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.595731 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.595862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.596064 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.596406 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.596592 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.596725 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.597045 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.597185 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.597361 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.597740 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.597916 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.598231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.598348 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.598587 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.598889 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.599127 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.599239 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.599519 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.599678 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.599831 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.600133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.600273 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.600542 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.600756 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.600862 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.601152 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.601376 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.601484 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.601752 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.605100 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.605254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.605254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.605428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.605516 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.605603 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.605701 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.605799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.605895 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.605991 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.606090 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.606183 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.606367 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.606476 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.606560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.606685 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.606776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.606776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.606776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.606776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.606776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.607155 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.607250 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.607250 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.607250 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.607504 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.607742 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.607889 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.608047 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.608397 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.608518 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.608700 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.609001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.609094 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.609314 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.609620 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.609735 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.609942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.610245 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.610349 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.610549 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.610854 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.610948 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.611165 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.611499 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.611654 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.611809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.612059 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.612161 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.612383 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.612695 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.612828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.613000 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.613309 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.613409 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.613612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.613922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.614022 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.614226 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.614535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.614637 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.614885 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.615328 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.615440 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.615538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.615823 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.615924 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.616117 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.616457 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.616590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.616845 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.617078 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.617173 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.617459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.617685 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.617891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.618797 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.618918 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.618918 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.619088 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.619181 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.619576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.619698 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.620055 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.620169 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.620418 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.620701 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.620842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.621024 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.621323 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.621426 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.621645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.621925 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.622068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.622310 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.622529 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.622624 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.622917 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.623121 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.623218 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.623521 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.623708 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.623826 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.624186 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.624290 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.624538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.624823 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.624919 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.625494 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.625615 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.625715 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.625803 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.625981 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.626118 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.626424 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.626606 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.626744 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.627062 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.627203 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.627375 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.627689 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.627796 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.627998 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.628358 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.628470 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.628749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.628992 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.629099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.629362 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.629605 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.629712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.629996 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.630199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.630303 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.630702 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.630809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.631011 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.631313 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.631484 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.631634 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.631924 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.632029 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.632338 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.632581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.632684 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.632946 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.633168 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.633273 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.633563 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.634358 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.634468 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.634887 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.634990 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.635356 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.635693 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.635807 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.635986 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.636223 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.636348 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.636669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.636892 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.637010 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.637288 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.637482 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.637585 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.637896 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.638095 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.638192 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.638500 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.638723 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.638828 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.639095 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.639336 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.639442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.639690 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.639956 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.640074 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.640327 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.640604 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.640735 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.640944 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.641439 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.641545 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.641793 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.642162 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.642269 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.642631 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.642733 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.643074 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.643179 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.643526 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.643628 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.643971 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.644073 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.644440 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.644570 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.644904 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.645045 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.645341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.645447 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.645819 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.645939 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.646232 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.646327 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.646677 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.646776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.647115 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.647226 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.647557 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.647661 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.648034 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.648137 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.648496 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.648613 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.648955 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.649050 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.649494 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.649614 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.649950 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.650066 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.650393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.650569 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.650858 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.651066 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.651302 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.651469 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.651749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.651923 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.652196 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.652404 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.652666 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.652861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.653110 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.653316 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.653557 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.653767 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.654124 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.654218 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.654578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.654680 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.655012 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.655115 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.655468 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.655564 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.655935 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.656054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.656386 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.656499 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.656833 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.657145 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.657285 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.657609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.657722 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.658060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.658162 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.658516 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.658618 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.658960 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.659063 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.659410 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.659518 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.659826 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.659934 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.660269 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.660458 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.660737 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.660854 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.661200 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.661315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.661622 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.661721 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.662082 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.662190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.662538 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.662684 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.662994 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.663101 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.663467 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.663563 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.663914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.664015 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.664382 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.664482 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.664830 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.665429 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.665982 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.666105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.666203 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.666522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.666631 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.666937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:24:21.667040 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.667402 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.667804 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.668207 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.668655 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.669049 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.669464 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.669847 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.670245 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.670749 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.671033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.671433 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.671849 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.672261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.672734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.673133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.673532 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.673931 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.674332 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.674984 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.675384 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.675806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.676261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.676680 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.677132 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.677495 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.677906 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.678295 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.678685 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.679083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.679480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.679869 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.680418 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.680913 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.681188 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.681596 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.681989 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.682678 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.683114 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.683515 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.683931 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.684369 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.684819 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.685208 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.685619 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.686011 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.686458 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.686791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.687186 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.687595 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.687986 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.688408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.688809 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.689199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.689590 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.690066 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.690381 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.690770 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.691157 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.691545 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.691943 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.692402 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.692776 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.693130 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.693519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.694296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.694296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.694698 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.695084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.695478 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.695989 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.696269 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.696898 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.697138 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.697529 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.697920 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.698327 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.698721 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.699141 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.699536 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.699931 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.700398 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.700798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.701475 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.701984 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.702288 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.702743 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.703160 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.703550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.703939 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.704342 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.704760 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.705152 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.705657 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.706092 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.706489 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.707088 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.707265 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.707944 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.708406 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.708771 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.709173 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.709875 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.710269 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.710681 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.711018 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.711394 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.711728 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.712664 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.713002 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.713484 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.713813 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.714137 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.714488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.714811 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.715140 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.715491 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.715819 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.716138 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.716638 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.716962 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.717291 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.717621 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.717942 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.718274 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.718608 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.718928 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.719257 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.719578 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.719919 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.720273 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.720640 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.720975 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.721292 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.721608 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.721921 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.722240 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.722582 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.722883 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.723198 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.723511 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.723828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.724139 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.724477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.724793 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.725106 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.725422 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.725733 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.726043 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.726354 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.726665 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.726977 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.727330 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.727719 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.728206 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.728614 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.728990 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.729307 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.729879 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.730233 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.730578 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.730907 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.731240 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.731562 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.732620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.732966 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.733286 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.733286 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.733286 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.734510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.734762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.735085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.735407 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.735727 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.736184 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.736591 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.736864 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.737274 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.738844 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.738844 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.738844 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.738844 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.738844 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.739618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.739618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.739900 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.740071 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.740400 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.740734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.741046 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.741381 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.741687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.742013 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.742350 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.742686 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.743005 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.743884 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.744555 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.744940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.745268 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.745628 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.745968 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.746293 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.746613 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.746928 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:24:21.747178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:24:21.827010 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO dbcounter [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] Registered counter for database nova_api Jul 12 18:24:21.848812 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_db.sqlalchemy.engines [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:24:21.857042 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writer thread running {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:24:21.902912 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO dbcounter [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] Registered counter for database nova_api Jul 12 18:24:21.914759 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.context [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6a061b3-df1d-42b4-9542-23af2c3404e0(cell1) {{(pid=118410) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 18:24:21.918777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:24:21.920391 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:24:21.921212 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:24:21.923202 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:24:21.923465 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_db.sqlalchemy.engines [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:24:21.925279 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO dbcounter [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] Registered counter for database nova_cell0 Jul 12 18:24:21.929487 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO dbcounter [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] Registered counter for database nova_cell1 Jul 12 18:24:21.931299 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writer thread running {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:24:21.938101 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_db.sqlalchemy.engines [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:24:21.940424 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_db.sqlalchemy.engines [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:24:21.945085 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writer thread running {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:24:21.951488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writer thread running {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:24:21.988942 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.context [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6a061b3-df1d-42b4-9542-23af2c3404e0(cell1) {{(pid=118411) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 18:24:21.993676 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:24:21.995325 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:24:21.996161 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:24:21.998178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:24:22.000213 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO dbcounter [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] Registered counter for database nova_cell0 Jul 12 18:24:22.004461 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO dbcounter [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] Registered counter for database nova_cell1 Jul 12 18:24:22.012919 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_db.sqlalchemy.engines [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:24:22.013799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_db.sqlalchemy.engines [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:24:22.021618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writer thread running {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:24:22.021970 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writer thread running {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:24:22.093210 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO dbcounter [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] Registered counter for database nova_cell0 Jul 12 18:24:22.099947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_db.sqlalchemy.engines [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:24:22.105826 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writer thread running {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:24:22.180055 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO dbcounter [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] Registered counter for database nova_cell0 Jul 12 18:24:22.187685 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_db.sqlalchemy.engines [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:24:22.193132 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writer thread running {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:24:22.439405 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: WARNING keystonemiddleware.auth_token [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:24:22.447463 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: WARNING keystonemiddleware.auth_token [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:24:22.521255 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: WARNING keystonemiddleware.auth_token [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:24:22.529934 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: WARNING keystonemiddleware.auth_token [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:24:22.798142 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: WARNING keystonemiddleware.auth_token [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:24:22.804275 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: WARNING keystonemiddleware.auth_token [None req-60fa5a60-5236-4cb6-92e8-200d29477ccc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:24:22.810125 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55edfb2d59c0 pid: 118410 (default app) Jul 12 18:24:22.873976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: WARNING keystonemiddleware.auth_token [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:24:22.879981 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: WARNING keystonemiddleware.auth_token [None req-f7df349e-119d-42ee-a436-f3794721d902 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:24:22.885519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55edfb2d59c0 pid: 118411 (default app) Jul 12 18:25:06.243239 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:06.244071 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:06.244814 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:06.245735 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:06.316796 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=3 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:06.319199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=3 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:06.321708 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=3 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:06.323268 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=3 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:08.171902 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9cfc5a1d-9f24-4806-9d63-f7ba9035cfc4 tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] Action: 'create', calling method: .version_select at 0x7f1bb2a8d5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-962980318", "metadata": {"Type": "work"}}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:08.178092 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0cd55e2b-c456-43c3-b074-10eb58a30089 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Action: 'create', calling method: .version_select at 0x7f1bb2a8e5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1631881802"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:11.236041 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9cfc5a1d-9f24-4806-9d63-f7ba9035cfc4 tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.936333 Jul 12 18:25:11.239933 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1155 bytes} [Tue Jul 12 18:25:06 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4943 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 18:25:11.255297 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-08203513-1a6f-435e-bedf-02f872b8334e tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] Calling method '.version_select at 0x7f1bb29534c0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:11.361324 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0cd55e2b-c456-43c3-b074-10eb58a30089 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 5.132010 Jul 12 18:25:11.362520 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 1/2] 10.222.0.47 () {60 vars in 1154 bytes} [Tue Jul 12 18:25:06 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 5135 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 12 18:25:11.375738 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f3c6e77d-14ad-4fb5-81ee-a92560ed7b70 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb29554c0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:11.544239 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-08203513-1a6f-435e-bedf-02f872b8334e tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b" status: 200 len: 352 microversion: 2.1 time: 0.295098 Jul 12 18:25:11.545129 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:11 2022] GET /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b => generated 352 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:11.613750 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f3c6e77d-14ad-4fb5-81ee-a92560ed7b70 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a" status: 200 len: 345 microversion: 2.1 time: 0.242029 Jul 12 18:25:11.617308 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:11 2022] GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a => generated 345 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:12.558551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9e3d9d9f-4dfc-4b16-af4b-4de0020c5d3a tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] Calling method '.version_select at 0x7f1bb2953790>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:12.630785 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8e582e85-dee9-4b3f-90d5-8e6d691d3fbf tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb2955820>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:12.684687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9e3d9d9f-4dfc-4b16-af4b-4de0020c5d3a tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b" status: 200 len: 353 microversion: 2.1 time: 0.132143 Jul 12 18:25:12.685421 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 3/5] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:12 2022] GET /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:12.701857 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-029d65f5-4182-47c7-8de7-91b957e1996e tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] Calling method '.version_select at 0x7f1bb2953ca0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:12.776792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8e582e85-dee9-4b3f-90d5-8e6d691d3fbf tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a" status: 200 len: 346 microversion: 2.1 time: 0.153651 Jul 12 18:25:12.779018 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 3/6] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:12 2022] GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a => generated 346 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:12.814754 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-324ad4a3-57a9-4662-b212-f80ad4acfd01 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Action: 'create', calling method: .version_select at 0x7f1bb2955b80>, body: {"snapshot": {"volume_id": "ce3244e0-73da-4f3b-8d8b-46870a45ab3a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1593443251"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:12.834451 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-029d65f5-4182-47c7-8de7-91b957e1996e tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b" status: 200 len: 353 microversion: 2.1 time: 0.136834 Jul 12 18:25:12.836058 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:12 2022] GET /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:12.858002 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8d926ec0-fcf5-4fed-a044-85c32ec5bb07 tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] Calling method '.version_select at 0x7f1bb29663a0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:13.744607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8d926ec0-fcf5-4fed-a044-85c32ec5bb07 tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b" status: 202 len: 0 microversion: 2.1 time: 0.895066 Jul 12 18:25:13.746815 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 5/8] 10.222.0.47 () {58 vars in 1247 bytes} [Tue Jul 12 18:25:12 2022] DELETE /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:25:13.761060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c775dbc0-ed52-4103-a65a-f61dc073614a tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] Calling method '.version_select at 0x7f1bb2953d30>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:14.058319 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c775dbc0-ed52-4103-a65a-f61dc073614a tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b" status: 200 len: 352 microversion: 2.1 time: 0.302691 Jul 12 18:25:14.059408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 6/9] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:13 2022] GET /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b => generated 352 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:14.562852 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-324ad4a3-57a9-4662-b212-f80ad4acfd01 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.775143 Jul 12 18:25:14.564092 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 4/10] 10.222.0.47 () {60 vars in 1161 bytes} [Tue Jul 12 18:25:12 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:14.581584 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-00f26849-1c01-4337-a2bb-416899b71f9d tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb29535e0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:15.074191 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-652e74ef-5bd9-41be-a530-127fa3dab3f7 tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] Calling method '.version_select at 0x7f1bb296d820>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:15.739032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-00f26849-1c01-4337-a2bb-416899b71f9d tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9" status: 200 len: 287 microversion: 2.1 time: 1.166640 Jul 12 18:25:15.751546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 7/11] 10.222.0.47 () {58 vars in 1250 bytes} [Tue Jul 12 18:25:14 2022] GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9 => generated 287 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:15.780533 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-652e74ef-5bd9-41be-a530-127fa3dab3f7 tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] HTTP exception thrown: Volume 56993d3b-10df-413e-b4aa-382ba6b85a3b could not be found. Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-652e74ef-5bd9-41be-a530-127fa3dab3f7 tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] Request method failure captured: Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b HTTP/1.1 Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyCAqmjVOXxQjxKvEE1cKp6E9hibFDP33f21lONguUjkewLnAjrYtSkXFXNXSKy8yrN11nhPdK5h6kD4DipwBmXV_aSmNyAC1gcdv6i6EgXom2OAaxb4iVsx1PgpYMz4ODe73IKEiJwAmH015oqUf4_8n0PBm5IP7RmmZp_4focYDw Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: d245c06c21604eff89d4b21cce3d657c Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesGetTestJSON-1459237374 Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:25:15.786856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d245c06c21604eff89d4b21cce3d657c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d245c06c21604eff89d4b21cce3d657c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d245c06c21604eff89d4b21cce3d657c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d245c06c21604eff89d4b21cce3d657c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesGetTestJSON-1459237374 Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: d245c06c21604eff89d4b21cce3d657c Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesGetTestJSON-1459237374 Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesGetTestJSON-1459237374-project Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: bcc57a9a38d14a79b27989dc57be4f4a Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesGetTestJSON-1459237374-project Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Volume 56993d3b-10df-413e-b4aa-382ba6b85a3b could not be found. Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '56993d3b-10df-413e-b4aa-382ba6b85a3b'} Jul 12 18:25:15.789806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 56993d3b-10df-413e-b4aa-382ba6b85a3b could not be found. (HTTP 404) (Request-ID: req-76b3a1b0-599c-4787-bf0d-1fe14bf66e1a) Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:15.791170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:25:15.796861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 56993d3b-10df-413e-b4aa-382ba6b85a3b could not be found. Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 18:25:15.799172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 56993d3b-10df-413e-b4aa-382ba6b85a3b could not be found. Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 56993d3b-10df-413e-b4aa-382ba6b85a3b could not be found. Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-652e74ef-5bd9-41be-a530-127fa3dab3f7 tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] Returning 404 to user: Volume 56993d3b-10df-413e-b4aa-382ba6b85a3b could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-652e74ef-5bd9-41be-a530-127fa3dab3f7 tempest-VolumesGetTestJSON-1459237374 tempest-VolumesGetTestJSON-1459237374-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b" status: 404 len: 109 microversion: 2.1 time: 0.721319 Jul 12 18:25:15.801189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 5/12] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:15 2022] GET /compute/v2.1/os-volumes/56993d3b-10df-413e-b4aa-382ba6b85a3b => generated 109 bytes in 722 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 18:25:15.804559 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-759592ae-df25-4f20-8a7f-8d8a11c7a44a tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb296dca0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:16.000467 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-759592ae-df25-4f20-8a7f-8d8a11c7a44a tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.210329 Jul 12 18:25:16.001509 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 6/13] 10.222.0.47 () {58 vars in 1139 bytes} [Tue Jul 12 18:25:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:16.012724 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c676b6bc-bece-4aa4-b33d-e21504ec8692 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb296d310>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:16.078704 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c676b6bc-bece-4aa4-b33d-e21504ec8692 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9" status: 200 len: 287 microversion: 2.1 time: 0.069906 Jul 12 18:25:16.081312 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 7/14] 10.222.0.47 () {58 vars in 1250 bytes} [Tue Jul 12 18:25:16 2022] GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:16.141038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-544640340", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:16.473961 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] validate_networks() for [('0d3cae64-ca18-412c-87e8-bfda7158b7f8', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:25:17.092649 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-377a01e9-6bfd-4627-bb8d-446149d8e29c tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb2a970d0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:17.166599 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-377a01e9-6bfd-4627-bb8d-446149d8e29c tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9" status: 200 len: 287 microversion: 2.1 time: 0.077906 Jul 12 18:25:17.167165 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 8/15] 10.222.0.47 () {58 vars in 1250 bytes} [Tue Jul 12 18:25:17 2022] GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:18.178209 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a223a24c-9ca5-4648-8e0d-6d6e6e9fd5ff tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb28da670>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:18.248989 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a223a24c-9ca5-4648-8e0d-6d6e6e9fd5ff tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9" status: 200 len: 287 microversion: 2.1 time: 0.074467 Jul 12 18:25:18.249760 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 9/16] 10.222.0.47 () {58 vars in 1250 bytes} [Tue Jul 12 18:25:18 2022] GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:18.923146 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:25:18.923146 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:25:18.923146 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:25:18.923146 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:25:18.923775 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:25:18.951445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:18.951902 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:18.952770 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:18.953224 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:19.023479 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Getting quotas for project 54167aa5315d4dd2b514ad4b027634f9. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:25:19.052663 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Getting quotas for user b58b0d520aa1418bb6ad3b5645a826a7 and project 54167aa5315d4dd2b514ad4b027634f9. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:25:19.086678 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:25:19.089692 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:25:19.278251 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a6ef09e7-f97a-4cd1-952c-4ebea4e78c11 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb28dad30>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:19.349674 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a6ef09e7-f97a-4cd1-952c-4ebea4e78c11 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9" status: 200 len: 288 microversion: 2.1 time: 0.091847 Jul 12 18:25:19.351058 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 10/17] 10.222.0.47 () {58 vars in 1250 bytes} [Tue Jul 12 18:25:19 2022] GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9 => generated 288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:19.367854 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0d41ee09-fcb6-419d-b68a-9a51c5242d5d tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb28daaf0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:19.368144 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e825679e-0374-4826-8c5d-3a71f9668581 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.617037 Jul 12 18:25:19.369739 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 8/18] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:25:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:25:19.384450 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-15abe651-49af-44a8-9d55-6f475fef5ee7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:19.404880 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-15abe651-49af-44a8-9d55-6f475fef5ee7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:19.631481 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-15abe651-49af-44a8-9d55-6f475fef5ee7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:19.684436 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-15abe651-49af-44a8-9d55-6f475fef5ee7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1221 microversion: 2.1 time: 0.304481 Jul 12 18:25:19.684513 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0d41ee09-fcb6-419d-b68a-9a51c5242d5d tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9" status: 202 len: 0 microversion: 2.1 time: 0.324574 Jul 12 18:25:19.684513 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 11/19] 10.222.0.47 () {58 vars in 1253 bytes} [Tue Jul 12 18:25:19 2022] DELETE /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:25:19.691687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b0099132-32e7-430c-be4a-602b851c3d29 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb28da430>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:19.694247 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 9/20] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:19 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1221 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:20.151570 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1383554504", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:20.262302 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] validate_networks() for [('0d3cae64-ca18-412c-87e8-bfda7158b7f8', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:25:20.727216 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-b0099132-32e7-430c-be4a-602b851c3d29 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] HTTP exception thrown: Snapshot 3119e171-98ff-4d08-8be5-ec0ebc7a49e9 could not be found. Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b0099132-32e7-430c-be4a-602b851c3d29 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Request method failure captured: Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9 HTTP/1.1 Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyC_JWXJ0Kb3OMlf5IFnuRgU01dT6-ZOIoUdCF14-Hf9JOi0_w8EFlhDlcUsKjigl3agZrJ-lVGPzfqfnW32EXP-QZYeFnspS1U_SwfQ0LSXKEhDj1oiagBBbeRXRR-u2IqcNzMT9sFmbkDQWppajF_Ztqdr2ppbSG2_tzhf3gsxo8 Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 3ee7ece325794a1182addebaaadda780 Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:25:20.730580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3ee7ece325794a1182addebaaadda780"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3ee7ece325794a1182addebaaadda780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3ee7ece325794a1182addebaaadda780", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3ee7ece325794a1182addebaaadda780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 3ee7ece325794a1182addebaaadda780 Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesSnapshotsTestJSON-565211521-project Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: e387020748424930b277ff88372bf474 Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesSnapshotsTestJSON-565211521-project Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Snapshot 3119e171-98ff-4d08-8be5-ec0ebc7a49e9 could not be found. Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '3119e171-98ff-4d08-8be5-ec0ebc7a49e9'} Jul 12 18:25:20.731709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3119e171-98ff-4d08-8be5-ec0ebc7a49e9 could not be found. (HTTP 404) (Request-ID: req-f1932c08-3518-4bd1-bf23-611bbd97bdf6) Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:20.733207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:25:20.734645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3119e171-98ff-4d08-8be5-ec0ebc7a49e9 could not be found. Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 18:25:20.735712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3119e171-98ff-4d08-8be5-ec0ebc7a49e9 could not be found. Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3119e171-98ff-4d08-8be5-ec0ebc7a49e9 could not be found. Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b0099132-32e7-430c-be4a-602b851c3d29 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Returning 404 to user: Snapshot 3119e171-98ff-4d08-8be5-ec0ebc7a49e9 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b0099132-32e7-430c-be4a-602b851c3d29 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9" status: 404 len: 111 microversion: 2.1 time: 1.045287 Jul 12 18:25:20.740558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 12/21] 10.222.0.47 () {58 vars in 1250 bytes} [Tue Jul 12 18:25:19 2022] GET /compute/v2.1/os-snapshots/3119e171-98ff-4d08-8be5-ec0ebc7a49e9 => generated 111 bytes in 1047 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:25:20.755064 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-770433bf-5433-486b-a6c7-7fab1adb7e58 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb3337a60>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:21.156058 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-770433bf-5433-486b-a6c7-7fab1adb7e58 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a" status: 202 len: 0 microversion: 2.1 time: 0.410718 Jul 12 18:25:21.156651 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 13/22] 10.222.0.47 () {58 vars in 1247 bytes} [Tue Jul 12 18:25:20 2022] DELETE /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:25:21.166353 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1135032e-6638-492a-99ba-e3611f7ee3da tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb28da790>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:21.329470 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1135032e-6638-492a-99ba-e3611f7ee3da tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a" status: 200 len: 345 microversion: 2.1 time: 0.168177 Jul 12 18:25:21.332371 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 14/23] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:21 2022] GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a => generated 345 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:22.159781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:25:22.159781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:25:22.159781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:25:22.159781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:25:22.159781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:25:22.215360 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:22.215360 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:22.220534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:22.222750 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:22.274896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Getting quotas for project 54167aa5315d4dd2b514ad4b027634f9. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:25:22.283441 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Getting quotas for user b58b0d520aa1418bb6ad3b5645a826a7 and project 54167aa5315d4dd2b514ad4b027634f9. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:25:22.346406 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:25:22.355049 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:25:22.626981 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-72edba0a-f7ce-4ea2-a401-dd6703609992 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.475780 Jul 12 18:25:22.627716 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 10/24] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:25:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 18:25:22.736815 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1163030447", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "networks": [{"uuid": "4063c3ff-2397-42c1-b125-4cc43e9b6fc3"}]}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:23.140924 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] validate_networks() for [('4063c3ff-2397-42c1-b125-4cc43e9b6fc3', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:25:23.257584 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a9dc9360-361d-429b-9cc1-3821a909a50c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Action: 'create', calling method: .version_select at 0x7f1bb1824ca0>, body: {"keypair": {"name": "tempest-keypair-118275102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDWKL0G3r0xO8JC5pMXA+8Of3KnfLRcj1757LcLgHyYL96ampNTAn2FlFKoU4OIw1s2eMOGiqOYOB1FME4Goc77LSZhfcM3OAaBe3xxZ90LY9vR6weX56M0h8ZcodnzcQ=="}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:23.329107 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-a9dc9360-361d-429b-9cc1-3821a909a50c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Getting quotas for project 775c525b714e4f13ac5f34314243fe93. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:25:23.341443 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-a9dc9360-361d-429b-9cc1-3821a909a50c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Getting quotas for user d5148114d71b401ca20f988485fb6c88 and project 775c525b714e4f13ac5f34314243fe93. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:25:23.546726 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a9dc9360-361d-429b-9cc1-3821a909a50c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.911340 Jul 12 18:25:23.550734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 11/25] 10.222.0.47 () {62 vars in 1199 bytes} [Tue Jul 12 18:25:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 914 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 18:25:23.560559 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c733de0f-977e-4466-b3f5-0851f3d18391 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb182ec10>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:23.697035 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c733de0f-977e-4466-b3f5-0851f3d18391 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a" status: 200 len: 345 microversion: 2.1 time: 0.147437 Jul 12 18:25:23.698052 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 12/26] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:23 2022] GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:23.724171 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4c0917d5-6426-46b6-8807-3cbab1fc3b0f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:23.726494 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4c0917d5-6426-46b6-8807-3cbab1fc3b0f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:24.025787 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4c0917d5-6426-46b6-8807-3cbab1fc3b0f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:24.065025 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4c0917d5-6426-46b6-8807-3cbab1fc3b0f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1222 microversion: 2.1 time: 0.363229 Jul 12 18:25:24.067750 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 13/27] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:23 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1222 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:24.512058 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0f79284f-0979-4a0b-96f2-4b0eaa304227 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Action: 'create', calling method: .version_select at 0x7f1bb17cef70>, body: {"keypair": {"name": "tempest-keypair-1363270877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX+98kvqQytn3cXH2UK+7E/gw2oe8AXcXJjkjv4giVOcljxytoQLgKAbPgfiIHfJPr/bkIabfiv2PelqhQ5LlYC/MmPSKHDwmKq35e/thPYAZqjp4JWxTlddIR0aIT13Q=="}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:24.587150 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-0f79284f-0979-4a0b-96f2-4b0eaa304227 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Getting quotas for project d00edd8bebc34098919b25aafca8974b. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:25:24.600084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-0f79284f-0979-4a0b-96f2-4b0eaa304227 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Getting quotas for user 29bc0d7e30794a6abb292dc65329ed9e and project d00edd8bebc34098919b25aafca8974b. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:25:24.778311 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0f79284f-0979-4a0b-96f2-4b0eaa304227 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.700064 Jul 12 18:25:24.779409 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 14/28] 10.222.0.47 () {60 vars in 1158 bytes} [Tue Jul 12 18:25:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:24.798230 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6adcd8c6-7914-48df-8499-5ad6d4f98892 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb17ce550>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:24.886275 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6adcd8c6-7914-48df-8499-5ad6d4f98892 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a" status: 200 len: 345 microversion: 2.1 time: 0.105756 Jul 12 18:25:24.887102 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 15/29] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:24 2022] GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a => generated 345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:25.083211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ce92453a-dc68-4df6-bb66-576ea7b8ff60 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:25.083978 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ce92453a-dc68-4df6-bb66-576ea7b8ff60 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:25.361465 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ce92453a-dc68-4df6-bb66-576ea7b8ff60 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:25.365517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ce92453a-dc68-4df6-bb66-576ea7b8ff60 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1222 microversion: 2.1 time: 0.286374 Jul 12 18:25:25.373102 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 16/30] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:25 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1222 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:25.507974 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:25:25.508427 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:25:25.508881 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:25:25.509285 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:25:25.509693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:25:25.535977 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:25.536466 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:25.537540 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:25.540381 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:25.591409 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Getting quotas for project 5ce90d7b4e2540d8a3417db6900d9243. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:25:25.599880 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Getting quotas for user e9f4e1de59734b3f87a982a50b5b2f91 and project 5ce90d7b4e2540d8a3417db6900d9243. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:25:25.615283 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:25:25.619035 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:25:25.833318 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5f835dc9-320c-4428-ba94-c77ddca791af tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.613322 Jul 12 18:25:25.835412 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 15/31] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:25:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:25:25.846228 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b13479df-12cf-411d-9a1a-f52efa1eb736 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:25.846847 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b13479df-12cf-411d-9a1a-f52efa1eb736 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:25.900698 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0d3b8c6b-1211-4101-a018-2fc3d6bfaade tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb1fda430>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:25.942599 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b13479df-12cf-411d-9a1a-f52efa1eb736 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:25.950508 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b13479df-12cf-411d-9a1a-f52efa1eb736 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1215 microversion: 2.1 time: 0.108026 Jul 12 18:25:25.961916 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 17/32] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:25 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:26.015391 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0d3b8c6b-1211-4101-a018-2fc3d6bfaade tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a" status: 200 len: 345 microversion: 2.1 time: 0.119607 Jul 12 18:25:26.016674 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 16/33] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:25 2022] GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:26.392906 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2919ede1-50ba-4c5f-8749-59142a240cc8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:26.396207 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2919ede1-50ba-4c5f-8749-59142a240cc8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:26.408876 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2919ede1-50ba-4c5f-8749-59142a240cc8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:26.409579 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2919ede1-50ba-4c5f-8749-59142a240cc8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:26.410624 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2919ede1-50ba-4c5f-8749-59142a240cc8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:26.411271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2919ede1-50ba-4c5f-8749-59142a240cc8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:26.623981 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2919ede1-50ba-4c5f-8749-59142a240cc8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:26.640705 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2919ede1-50ba-4c5f-8749-59142a240cc8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1226 microversion: 2.1 time: 0.255899 Jul 12 18:25:26.641683 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 18/34] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:26 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1226 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:26.974104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e70fbf82-6fee-417a-988d-d8962ba58f26 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:26.977087 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e70fbf82-6fee-417a-988d-d8962ba58f26 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:27.034736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0b1e1c00-e0a0-40eb-9761-8f77d592e29b tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb0f42820>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:27.249908 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0b1e1c00-e0a0-40eb-9761-8f77d592e29b tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a" status: 200 len: 345 microversion: 2.1 time: 0.222765 Jul 12 18:25:27.251379 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 19/35] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:27 2022] GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a => generated 345 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:27.368293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e70fbf82-6fee-417a-988d-d8962ba58f26 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:27.412137 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e70fbf82-6fee-417a-988d-d8962ba58f26 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1215 microversion: 2.1 time: 0.447202 Jul 12 18:25:27.424814 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 17/36] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:26 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1215 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:27.665841 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7a7472fb-ae12-45f9-9993-97c28ace7dd9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:27.666496 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7a7472fb-ae12-45f9-9993-97c28ace7dd9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:27.712452 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a7472fb-ae12-45f9-9993-97c28ace7dd9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:27.712452 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a7472fb-ae12-45f9-9993-97c28ace7dd9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:27.712452 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a7472fb-ae12-45f9-9993-97c28ace7dd9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:27.712452 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a7472fb-ae12-45f9-9993-97c28ace7dd9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:27.941553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7a7472fb-ae12-45f9-9993-97c28ace7dd9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:27.954506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7a7472fb-ae12-45f9-9993-97c28ace7dd9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1218 microversion: 2.1 time: 0.298692 Jul 12 18:25:27.955097 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 20/37] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:27 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1218 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:28.263641 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-165f99ae-afd2-49a4-a6c4-efe16001b8f9 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb1fda4c0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:28.430822 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cba4237d-22a0-4322-9312-49ce56225161 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:28.432580 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-cba4237d-22a0-4322-9312-49ce56225161 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:28.469775 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cba4237d-22a0-4322-9312-49ce56225161 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:28.470788 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cba4237d-22a0-4322-9312-49ce56225161 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:28.472292 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cba4237d-22a0-4322-9312-49ce56225161 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:28.473033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cba4237d-22a0-4322-9312-49ce56225161 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:28.718038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-cba4237d-22a0-4322-9312-49ce56225161 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:28.759364 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-cba4237d-22a0-4322-9312-49ce56225161 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1211 microversion: 2.1 time: 0.304308 Jul 12 18:25:28.760182 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 21/38] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:28 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1211 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:28.971674 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-165f99ae-afd2-49a4-a6c4-efe16001b8f9 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] HTTP exception thrown: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-165f99ae-afd2-49a4-a6c4-efe16001b8f9 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Request method failure captured: Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a HTTP/1.1 Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyC_JWXJ0Kb3OMlf5IFnuRgU01dT6-ZOIoUdCF14-Hf9JOi0_w8EFlhDlcUsKjigl3agZrJ-lVGPzfqfnW32EXP-QZYeFnspS1U_SwfQ0LSXKEhDj1oiagBBbeRXRR-u2IqcNzMT9sFmbkDQWppajF_Ztqdr2ppbSG2_tzhf3gsxo8 Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 3ee7ece325794a1182addebaaadda780 Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:25:28.977551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3ee7ece325794a1182addebaaadda780"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3ee7ece325794a1182addebaaadda780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3ee7ece325794a1182addebaaadda780", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3ee7ece325794a1182addebaaadda780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 3ee7ece325794a1182addebaaadda780 Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesSnapshotsTestJSON-565211521-project Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: e387020748424930b277ff88372bf474 Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesSnapshotsTestJSON-565211521-project Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'ce3244e0-73da-4f3b-8d8b-46870a45ab3a'} Jul 12 18:25:28.978937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. (HTTP 404) (Request-ID: req-6fa1a3c1-5f49-4581-b56f-5d15e3935a81) Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:28.980374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:25:28.981471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 18:25:28.982918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-165f99ae-afd2-49a4-a6c4-efe16001b8f9 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Returning 404 to user: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:25:28.984455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-165f99ae-afd2-49a4-a6c4-efe16001b8f9 tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a" status: 404 len: 109 microversion: 2.1 time: 0.719698 Jul 12 18:25:28.993536 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4359e985-be06-4495-bb58-844582d7a603 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:28.995486 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4359e985-be06-4495-bb58-844582d7a603 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:28.996404 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 18/39] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:28 2022] GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a => generated 109 bytes in 738 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:25:29.002849 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-afe08ba1-8ebd-4a6b-a8a5-fa35c1945fbc tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb1780820>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:29.009213 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4359e985-be06-4495-bb58-844582d7a603 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:29.009610 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4359e985-be06-4495-bb58-844582d7a603 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:29.013822 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4359e985-be06-4495-bb58-844582d7a603 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:29.014705 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4359e985-be06-4495-bb58-844582d7a603 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:29.243682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-afe08ba1-8ebd-4a6b-a8a5-fa35c1945fbc tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] HTTP exception thrown: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-afe08ba1-8ebd-4a6b-a8a5-fa35c1945fbc tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Request method failure captured: Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a HTTP/1.1 Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyC_JWXJ0Kb3OMlf5IFnuRgU01dT6-ZOIoUdCF14-Hf9JOi0_w8EFlhDlcUsKjigl3agZrJ-lVGPzfqfnW32EXP-QZYeFnspS1U_SwfQ0LSXKEhDj1oiagBBbeRXRR-u2IqcNzMT9sFmbkDQWppajF_Ztqdr2ppbSG2_tzhf3gsxo8 Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 3ee7ece325794a1182addebaaadda780 Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:25:29.246037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3ee7ece325794a1182addebaaadda780"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3ee7ece325794a1182addebaaadda780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3ee7ece325794a1182addebaaadda780", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3ee7ece325794a1182addebaaadda780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 3ee7ece325794a1182addebaaadda780 Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesSnapshotsTestJSON-565211521-project Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: e387020748424930b277ff88372bf474 Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesSnapshotsTestJSON-565211521-project Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'ce3244e0-73da-4f3b-8d8b-46870a45ab3a'} Jul 12 18:25:29.247379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. (HTTP 404) (Request-ID: req-27e38206-382e-4809-92bb-68a07dca2d5a) Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:29.248326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:25:29.249486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 18:25:29.250847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:25:29.251961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:29.251961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.251961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:29.251961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.251961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:29.251961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:25:29.251961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:25:29.251961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:25:29.251961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:25:29.251961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:29.251961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.253589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-afe08ba1-8ebd-4a6b-a8a5-fa35c1945fbc tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Returning 404 to user: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:25:29.254578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-afe08ba1-8ebd-4a6b-a8a5-fa35c1945fbc tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a" status: 404 len: 109 microversion: 2.1 time: 0.257024 Jul 12 18:25:29.255281 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 19/40] 10.222.0.47 () {58 vars in 1247 bytes} [Tue Jul 12 18:25:28 2022] DELETE /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a => generated 109 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:25:29.262151 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1051305918", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31be3c15-cac8-48f6-8041-27a3024cda4f"}], "security_groups": [{"name": "tempest-securitygroup--1324535500"}], "key_name": "tempest-keypair-118275102", "user_data": "}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:29.309773 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4359e985-be06-4495-bb58-844582d7a603 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:29.344355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4359e985-be06-4495-bb58-844582d7a603 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1282 microversion: 2.1 time: 0.359843 Jul 12 18:25:29.346931 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 22/41] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:28 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1282 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:29.370846 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2a87a4a0-61fd-4cc2-a116-b98928f26e3c tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Calling method '.version_select at 0x7f1bb0f4cc10>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:29.535609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-2a87a4a0-61fd-4cc2-a116-b98928f26e3c tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] HTTP exception thrown: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2a87a4a0-61fd-4cc2-a116-b98928f26e3c tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Request method failure captured: Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a HTTP/1.1 Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizbyC_JWXJ0Kb3OMlf5IFnuRgU01dT6-ZOIoUdCF14-Hf9JOi0_w8EFlhDlcUsKjigl3agZrJ-lVGPzfqfnW32EXP-QZYeFnspS1U_SwfQ0LSXKEhDj1oiagBBbeRXRR-u2IqcNzMT9sFmbkDQWppajF_Ztqdr2ppbSG2_tzhf3gsxo8 Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 3ee7ece325794a1182addebaaadda780 Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:25:29.541463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3ee7ece325794a1182addebaaadda780"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/3ee7ece325794a1182addebaaadda780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_3ee7ece325794a1182addebaaadda780", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/3ee7ece325794a1182addebaaadda780"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 3ee7ece325794a1182addebaaadda780 Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-565211521 Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-VolumesSnapshotsTestJSON-565211521-project Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: e387020748424930b277ff88372bf474 Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-VolumesSnapshotsTestJSON-565211521-project Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': 'ce3244e0-73da-4f3b-8d8b-46870a45ab3a'} Jul 12 18:25:29.542768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. (HTTP 404) (Request-ID: req-c86f2097-8ff3-490c-b90b-70c7c7688357) Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:29.543517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:25:29.544530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 18:25:29.545477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2a87a4a0-61fd-4cc2-a116-b98928f26e3c tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] Returning 404 to user: Volume ce3244e0-73da-4f3b-8d8b-46870a45ab3a could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:25:29.546410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2a87a4a0-61fd-4cc2-a116-b98928f26e3c tempest-VolumesSnapshotsTestJSON-565211521 tempest-VolumesSnapshotsTestJSON-565211521-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a" status: 404 len: 109 microversion: 2.1 time: 0.195916 Jul 12 18:25:29.552090 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 23/42] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:25:29 2022] GET /compute/v2.1/os-volumes/ce3244e0-73da-4f3b-8d8b-46870a45ab3a => generated 109 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:25:29.826708 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-43687cde-9be4-4675-b62c-63b38c36d69c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:29.826708 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-43687cde-9be4-4675-b62c-63b38c36d69c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:29.826708 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43687cde-9be4-4675-b62c-63b38c36d69c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:29.826708 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43687cde-9be4-4675-b62c-63b38c36d69c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:29.827976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43687cde-9be4-4675-b62c-63b38c36d69c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:29.827976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43687cde-9be4-4675-b62c-63b38c36d69c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:29.828247 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] validate_networks() for [('31be3c15-cac8-48f6-8041-27a3024cda4f', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:25:29.957626 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-43687cde-9be4-4675-b62c-63b38c36d69c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:29.966340 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-43687cde-9be4-4675-b62c-63b38c36d69c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1267 microversion: 2.1 time: 0.192167 Jul 12 18:25:29.981919 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 24/43] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:29 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:30.356898 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-08a03f26-bbe9-4b9a-8b90-451facda563a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:30.362136 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-08a03f26-bbe9-4b9a-8b90-451facda563a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:30.374604 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-08a03f26-bbe9-4b9a-8b90-451facda563a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:30.379043 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-08a03f26-bbe9-4b9a-8b90-451facda563a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:30.382114 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-08a03f26-bbe9-4b9a-8b90-451facda563a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:30.383181 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-08a03f26-bbe9-4b9a-8b90-451facda563a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:30.741733 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-08a03f26-bbe9-4b9a-8b90-451facda563a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:30.769291 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-08a03f26-bbe9-4b9a-8b90-451facda563a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1280 microversion: 2.1 time: 0.419261 Jul 12 18:25:30.789075 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 25/44] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:30 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1280 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:30.984063 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a59fe378-a4ba-4cc6-8cb8-ca3f0aff1197 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:30.984793 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a59fe378-a4ba-4cc6-8cb8-ca3f0aff1197 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:30.996811 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a59fe378-a4ba-4cc6-8cb8-ca3f0aff1197 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:30.999800 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a59fe378-a4ba-4cc6-8cb8-ca3f0aff1197 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:31.000761 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a59fe378-a4ba-4cc6-8cb8-ca3f0aff1197 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:31.001728 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a59fe378-a4ba-4cc6-8cb8-ca3f0aff1197 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:31.239266 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a59fe378-a4ba-4cc6-8cb8-ca3f0aff1197 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:31.259695 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a59fe378-a4ba-4cc6-8cb8-ca3f0aff1197 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1273 microversion: 2.1 time: 0.280269 Jul 12 18:25:31.260743 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 26/45] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:30 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:31.713456 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1682620800", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7032ac62-2013-478c-b8b7-c90e03eb0070"}], "security_groups": [{"name": "tempest-securitygroup--16383465"}], "key_name": "tempest-keypair-1363270877", "user_data": "}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:31.851054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:25:31.851054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:25:31.851054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:25:31.851054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:25:31.851054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:25:31.884207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:31.887336 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:31.890083 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:31.893354 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:31.935611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Getting quotas for project 775c525b714e4f13ac5f34314243fe93. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:25:31.945216 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Getting quotas for user d5148114d71b401ca20f988485fb6c88 and project 775c525b714e4f13ac5f34314243fe93. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:25:31.982693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:25:31.988460 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:25:32.248934 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=4 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:32.284331 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5d06be8e-de55-4faf-adb8-599705a5301d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.023477 Jul 12 18:25:32.285318 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 20/46] 10.222.0.47 () {62 vars in 1187 bytes} [Tue Jul 12 18:25:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 3029 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 18:25:32.302016 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e0d9f7ae-b619-4273-9024-396c94e4d47b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:32.303693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e0d9f7ae-b619-4273-9024-396c94e4d47b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:32.321923 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0d9f7ae-b619-4273-9024-396c94e4d47b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:32.325877 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0d9f7ae-b619-4273-9024-396c94e4d47b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:32.325877 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0d9f7ae-b619-4273-9024-396c94e4d47b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:32.325877 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0d9f7ae-b619-4273-9024-396c94e4d47b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:32.863480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e0d9f7ae-b619-4273-9024-396c94e4d47b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:32.886267 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e0d9f7ae-b619-4273-9024-396c94e4d47b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1280 microversion: 2.1 time: 0.595683 Jul 12 18:25:32.895987 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 21/47] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:32 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1280 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:32.901852 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-afd6ad2b-547b-402f-915f-5120f0d287ee tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:32.906748 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-afd6ad2b-547b-402f-915f-5120f0d287ee tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:32.925478 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-afd6ad2b-547b-402f-915f-5120f0d287ee tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:32.925957 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-afd6ad2b-547b-402f-915f-5120f0d287ee tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:32.932973 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-afd6ad2b-547b-402f-915f-5120f0d287ee tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:32.933733 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-afd6ad2b-547b-402f-915f-5120f0d287ee tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:32.945835 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] validate_networks() for [('7032ac62-2013-478c-b8b7-c90e03eb0070', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:25:33.344200 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-afd6ad2b-547b-402f-915f-5120f0d287ee tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:33.355750 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-afd6ad2b-547b-402f-915f-5120f0d287ee tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.465622 Jul 12 18:25:33.367460 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 22/48] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:32 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:33.375724 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-382fb750-428f-4157-8052-a19841840ef1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:33.378147 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-382fb750-428f-4157-8052-a19841840ef1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:33.441183 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-382fb750-428f-4157-8052-a19841840ef1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:33.453938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-382fb750-428f-4157-8052-a19841840ef1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:33.458683 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-382fb750-428f-4157-8052-a19841840ef1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:33.460584 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-382fb750-428f-4157-8052-a19841840ef1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1281 microversion: 2.20 time: 0.091828 Jul 12 18:25:33.464927 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 23/49] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:33 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:33.905273 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-72bde8f7-f3e1-401e-83e1-43633248cf32 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:33.906821 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-72bde8f7-f3e1-401e-83e1-43633248cf32 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:33.922291 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-72bde8f7-f3e1-401e-83e1-43633248cf32 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:33.927583 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-72bde8f7-f3e1-401e-83e1-43633248cf32 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:33.927583 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-72bde8f7-f3e1-401e-83e1-43633248cf32 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:33.940291 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-72bde8f7-f3e1-401e-83e1-43633248cf32 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:34.373806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:25:34.374352 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:25:34.374923 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:25:34.375556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:25:34.375973 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:25:34.397839 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:34.398314 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:34.399134 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:34.399577 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:34.449821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Getting quotas for project d00edd8bebc34098919b25aafca8974b. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:25:34.465897 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Getting quotas for user 29bc0d7e30794a6abb292dc65329ed9e and project d00edd8bebc34098919b25aafca8974b. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:25:34.484217 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:34.485888 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:25:34.488449 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:25:34.694622 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3affc6c5-2b89-4e82-abe9-1c11d4b8c3d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.986824 Jul 12 18:25:34.704373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 27/50] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:25:31 2022] POST /compute/v2.1/servers => generated 400 bytes in 2999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:25:34.720594 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-481a10bd-25eb-4c2a-a749-b47388905d95 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:34.721904 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-481a10bd-25eb-4c2a-a749-b47388905d95 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:34.731691 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-481a10bd-25eb-4c2a-a749-b47388905d95 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:34.732393 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-481a10bd-25eb-4c2a-a749-b47388905d95 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:34.734193 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-481a10bd-25eb-4c2a-a749-b47388905d95 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:34.735088 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-481a10bd-25eb-4c2a-a749-b47388905d95 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:34.940177 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-72bde8f7-f3e1-401e-83e1-43633248cf32 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:34.956918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-72bde8f7-f3e1-401e-83e1-43633248cf32 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 1.052217 Jul 12 18:25:34.984439 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 24/51] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:33 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:34.997166 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bff2974a-3434-4bbf-a27b-29316f7496b8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:34.998924 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bff2974a-3434-4bbf-a27b-29316f7496b8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:35.019698 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bff2974a-3434-4bbf-a27b-29316f7496b8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:35.020211 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bff2974a-3434-4bbf-a27b-29316f7496b8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:35.021410 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bff2974a-3434-4bbf-a27b-29316f7496b8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:35.022279 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bff2974a-3434-4bbf-a27b-29316f7496b8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:35.290481 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-481a10bd-25eb-4c2a-a749-b47388905d95 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:35.299922 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-481a10bd-25eb-4c2a-a749-b47388905d95 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.593705 Jul 12 18:25:35.305769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 28/52] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:34 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:35.310922 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-395a9256-745c-46ee-b29f-cf4df649f067 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:35.315401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-395a9256-745c-46ee-b29f-cf4df649f067 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:35.404190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bff2974a-3434-4bbf-a27b-29316f7496b8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:35.423169 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bff2974a-3434-4bbf-a27b-29316f7496b8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:35.425840 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bff2974a-3434-4bbf-a27b-29316f7496b8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:35.426990 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bff2974a-3434-4bbf-a27b-29316f7496b8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1285 microversion: 2.20 time: 0.439986 Jul 12 18:25:35.427557 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 25/53] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:34 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1285 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:35.449966 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-395a9256-745c-46ee-b29f-cf4df649f067 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:35.458294 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-395a9256-745c-46ee-b29f-cf4df649f067 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1238 microversion: 2.1 time: 0.151285 Jul 12 18:25:35.458874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 29/54] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:35 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1238 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:35.986289 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-28acb85a-69a3-491e-8b53-fe636d145573 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:35.988450 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-28acb85a-69a3-491e-8b53-fe636d145573 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:35.998162 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28acb85a-69a3-491e-8b53-fe636d145573 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:35.999230 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28acb85a-69a3-491e-8b53-fe636d145573 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:36.000671 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28acb85a-69a3-491e-8b53-fe636d145573 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:36.008703 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28acb85a-69a3-491e-8b53-fe636d145573 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:36.330465 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2db88902-355a-4200-b828-6db8e0969f83 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:36.331269 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2db88902-355a-4200-b828-6db8e0969f83 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:36.375072 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2db88902-355a-4200-b828-6db8e0969f83 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:36.379342 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2db88902-355a-4200-b828-6db8e0969f83 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:36.386222 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2db88902-355a-4200-b828-6db8e0969f83 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:36.388343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2db88902-355a-4200-b828-6db8e0969f83 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:36.895466 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2db88902-355a-4200-b828-6db8e0969f83 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:36.912130 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2db88902-355a-4200-b828-6db8e0969f83 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.594498 Jul 12 18:25:36.913791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 30/55] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:36 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:36.920724 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-dc6ea1f8-2be1-4c2a-8ff1-8a0e62509daa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:36.922500 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-dc6ea1f8-2be1-4c2a-8ff1-8a0e62509daa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:36.932787 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc6ea1f8-2be1-4c2a-8ff1-8a0e62509daa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:36.941703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc6ea1f8-2be1-4c2a-8ff1-8a0e62509daa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:36.941703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc6ea1f8-2be1-4c2a-8ff1-8a0e62509daa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:36.941703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc6ea1f8-2be1-4c2a-8ff1-8a0e62509daa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:37.201094 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-dc6ea1f8-2be1-4c2a-8ff1-8a0e62509daa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:37.214596 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-dc6ea1f8-2be1-4c2a-8ff1-8a0e62509daa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:37.216366 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-dc6ea1f8-2be1-4c2a-8ff1-8a0e62509daa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:37.230945 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-dc6ea1f8-2be1-4c2a-8ff1-8a0e62509daa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1333 microversion: 2.20 time: 0.304105 Jul 12 18:25:37.233352 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 31/56] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:36 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1333 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:37.236896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-458e0d1a-fb83-404a-9ae2-3c673480abd2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:37.237663 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-458e0d1a-fb83-404a-9ae2-3c673480abd2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:37.263665 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-458e0d1a-fb83-404a-9ae2-3c673480abd2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:37.269832 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-458e0d1a-fb83-404a-9ae2-3c673480abd2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:37.276886 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-458e0d1a-fb83-404a-9ae2-3c673480abd2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:37.278175 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-458e0d1a-fb83-404a-9ae2-3c673480abd2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:37.344264 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-28acb85a-69a3-491e-8b53-fe636d145573 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:37.375863 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-28acb85a-69a3-491e-8b53-fe636d145573 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 1.404338 Jul 12 18:25:37.395271 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 26/57] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:35 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:37.624083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-458e0d1a-fb83-404a-9ae2-3c673480abd2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:37.648127 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-458e0d1a-fb83-404a-9ae2-3c673480abd2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1242 microversion: 2.1 time: 0.408459 Jul 12 18:25:37.652516 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 32/58] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:37 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1242 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:37.932889 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7e1aeafc-e37b-4853-aa3f-3d1ab8026dad tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:37.933642 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7e1aeafc-e37b-4853-aa3f-3d1ab8026dad tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:37.954382 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7e1aeafc-e37b-4853-aa3f-3d1ab8026dad tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:37.957197 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7e1aeafc-e37b-4853-aa3f-3d1ab8026dad tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:37.958334 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7e1aeafc-e37b-4853-aa3f-3d1ab8026dad tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:37.958939 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7e1aeafc-e37b-4853-aa3f-3d1ab8026dad tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:38.113534 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-c27d1a23-015e-4f77-bdf1-e1383a126ec7 req-810e3117-f43b-49ec-b9f2-a458bfa80692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2004c12c-256b-47fa-a5bf-9517bcc06b57", "tag": "43bea616-9f1c-4981-ad8a-ef451790c6d4"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:38.138652 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-c27d1a23-015e-4f77-bdf1-e1383a126ec7 req-810e3117-f43b-49ec-b9f2-a458bfa80692 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:38.144361 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-c27d1a23-015e-4f77-bdf1-e1383a126ec7 req-810e3117-f43b-49ec-b9f2-a458bfa80692 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:38.224767 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-c27d1a23-015e-4f77-bdf1-e1383a126ec7 req-810e3117-f43b-49ec-b9f2-a458bfa80692 service nova] Creating event network-changed:43bea616-9f1c-4981-ad8a-ef451790c6d4 for instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 on hv-cinder-84488 Jul 12 18:25:38.230408 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-c27d1a23-015e-4f77-bdf1-e1383a126ec7 req-810e3117-f43b-49ec-b9f2-a458bfa80692 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 18:25:38.236641 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bda62945-b84e-43ef-9f5a-d42269a874b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:38.238808 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bda62945-b84e-43ef-9f5a-d42269a874b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:38.243444 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bda62945-b84e-43ef-9f5a-d42269a874b2 None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:38.244615 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bda62945-b84e-43ef-9f5a-d42269a874b2 None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:38.277996 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.compute.rpcapi [None req-bda62945-b84e-43ef-9f5a-d42269a874b2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 18:25:38.285245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bda62945-b84e-43ef-9f5a-d42269a874b2 None None] Releasing lock "compute-rpcapi-router" {{(pid=118410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 18:25:38.344211 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bda62945-b84e-43ef-9f5a-d42269a874b2 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.964096 Jul 12 18:25:38.349377 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 27/59] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:38.356966 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ec16a7da-3651-422b-a79e-5405bedfdf28 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:38.359938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ec16a7da-3651-422b-a79e-5405bedfdf28 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:38.377047 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec16a7da-3651-422b-a79e-5405bedfdf28 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:38.377802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec16a7da-3651-422b-a79e-5405bedfdf28 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:38.378848 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec16a7da-3651-422b-a79e-5405bedfdf28 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:38.379504 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec16a7da-3651-422b-a79e-5405bedfdf28 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:38.604602 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7e1aeafc-e37b-4853-aa3f-3d1ab8026dad tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:38.611080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ec16a7da-3651-422b-a79e-5405bedfdf28 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:38.613863 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7e1aeafc-e37b-4853-aa3f-3d1ab8026dad tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.686875 Jul 12 18:25:38.615834 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 33/60] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:37 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:38.623590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ec16a7da-3651-422b-a79e-5405bedfdf28 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:38.632904 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-64fb6659-bb08-4e8c-99db-291dc5e9f6d0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:38.633533 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-64fb6659-bb08-4e8c-99db-291dc5e9f6d0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:38.634148 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ec16a7da-3651-422b-a79e-5405bedfdf28 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:38.637842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ec16a7da-3651-422b-a79e-5405bedfdf28 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1339 microversion: 2.20 time: 0.285784 Jul 12 18:25:38.638606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 28/61] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:38 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1339 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:38.661723 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-64fb6659-bb08-4e8c-99db-291dc5e9f6d0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:38.662034 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-64fb6659-bb08-4e8c-99db-291dc5e9f6d0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:38.669925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-41a804f2-dacd-40f6-8980-d6bba05f9928 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:38.674924 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-41a804f2-dacd-40f6-8980-d6bba05f9928 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:38.703885 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41a804f2-dacd-40f6-8980-d6bba05f9928 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:38.704599 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41a804f2-dacd-40f6-8980-d6bba05f9928 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:38.707226 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41a804f2-dacd-40f6-8980-d6bba05f9928 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:38.707884 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-64fb6659-bb08-4e8c-99db-291dc5e9f6d0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:38.708208 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41a804f2-dacd-40f6-8980-d6bba05f9928 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:38.709198 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-64fb6659-bb08-4e8c-99db-291dc5e9f6d0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:38.982764 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-41a804f2-dacd-40f6-8980-d6bba05f9928 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:38.995045 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-41a804f2-dacd-40f6-8980-d6bba05f9928 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1290 microversion: 2.1 time: 0.329654 Jul 12 18:25:39.009223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 29/62] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:38 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1290 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:39.065529 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-64fb6659-bb08-4e8c-99db-291dc5e9f6d0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:39.078232 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-64fb6659-bb08-4e8c-99db-291dc5e9f6d0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.460989 Jul 12 18:25:39.082706 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 34/63] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:38 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:39.431225 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-5e52761a-b5a6-46bd-8d02-755e884416bf req-d5d720c6-6697-4e7c-a7cd-541b6d0db3da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b08a5b52-4e63-4914-b23c-3818819f7890", "tag": "f7fc27cc-a730-4429-a8a5-fde8e8b27309"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:39.454517 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-5e52761a-b5a6-46bd-8d02-755e884416bf req-d5d720c6-6697-4e7c-a7cd-541b6d0db3da service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:39.454957 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-5e52761a-b5a6-46bd-8d02-755e884416bf req-d5d720c6-6697-4e7c-a7cd-541b6d0db3da service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:39.501988 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-5e52761a-b5a6-46bd-8d02-755e884416bf req-d5d720c6-6697-4e7c-a7cd-541b6d0db3da service nova] Creating event network-changed:f7fc27cc-a730-4429-a8a5-fde8e8b27309 for instance b08a5b52-4e63-4914-b23c-3818819f7890 on hv-cinder-84488 Jul 12 18:25:39.534446 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-5e52761a-b5a6-46bd-8d02-755e884416bf req-d5d720c6-6697-4e7c-a7cd-541b6d0db3da service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.502551 Jul 12 18:25:39.541370 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 30/64] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:39.635106 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7476431d-0c9d-4222-9091-57670e780fac tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:39.638455 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7476431d-0c9d-4222-9091-57670e780fac tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:39.664864 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a1861419-4df7-410d-ad9a-a3dabede5818 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:39.665588 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a1861419-4df7-410d-ad9a-a3dabede5818 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:39.667585 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7476431d-0c9d-4222-9091-57670e780fac tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:39.675475 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7476431d-0c9d-4222-9091-57670e780fac tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:39.684961 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7476431d-0c9d-4222-9091-57670e780fac tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:39.691971 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1861419-4df7-410d-ad9a-a3dabede5818 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:39.691971 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1861419-4df7-410d-ad9a-a3dabede5818 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:39.692219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7476431d-0c9d-4222-9091-57670e780fac tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:39.701158 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1861419-4df7-410d-ad9a-a3dabede5818 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:39.701910 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1861419-4df7-410d-ad9a-a3dabede5818 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:40.100986 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a1861419-4df7-410d-ad9a-a3dabede5818 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:40.118842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a1861419-4df7-410d-ad9a-a3dabede5818 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:40.126562 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a1861419-4df7-410d-ad9a-a3dabede5818 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:40.132361 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a1861419-4df7-410d-ad9a-a3dabede5818 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1339 microversion: 2.20 time: 0.468662 Jul 12 18:25:40.146457 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 31/65] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:39 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1339 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:25:40.161384 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c02816e3-16a3-44cb-84e1-38cfdde109f3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:40.163136 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c02816e3-16a3-44cb-84e1-38cfdde109f3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:40.185275 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c02816e3-16a3-44cb-84e1-38cfdde109f3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:40.186300 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c02816e3-16a3-44cb-84e1-38cfdde109f3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:40.187384 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c02816e3-16a3-44cb-84e1-38cfdde109f3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:40.188247 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c02816e3-16a3-44cb-84e1-38cfdde109f3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:40.402100 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c02816e3-16a3-44cb-84e1-38cfdde109f3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:40.411553 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c02816e3-16a3-44cb-84e1-38cfdde109f3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1308 microversion: 2.1 time: 0.263203 Jul 12 18:25:40.416699 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 32/66] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:40 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1308 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:40.455650 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-82ad9526-5918-4fa4-be1a-c20f2860298a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:40.458449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-82ad9526-5918-4fa4-be1a-c20f2860298a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:40.474211 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-82ad9526-5918-4fa4-be1a-c20f2860298a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:40.474886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-82ad9526-5918-4fa4-be1a-c20f2860298a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:40.476001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-82ad9526-5918-4fa4-be1a-c20f2860298a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:40.477160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-82ad9526-5918-4fa4-be1a-c20f2860298a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:40.834758 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7476431d-0c9d-4222-9091-57670e780fac tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:40.850989 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7476431d-0c9d-4222-9091-57670e780fac tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 1.222430 Jul 12 18:25:40.853100 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 35/67] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:39 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:41.160837 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1942a58b-3243-4609-bb5f-85ddade025e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:41.161761 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1942a58b-3243-4609-bb5f-85ddade025e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:41.177429 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1942a58b-3243-4609-bb5f-85ddade025e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:41.181769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1942a58b-3243-4609-bb5f-85ddade025e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:41.182657 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1942a58b-3243-4609-bb5f-85ddade025e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:41.183105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1942a58b-3243-4609-bb5f-85ddade025e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:41.337174 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1942a58b-3243-4609-bb5f-85ddade025e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:41.354517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1942a58b-3243-4609-bb5f-85ddade025e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:41.369263 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1942a58b-3243-4609-bb5f-85ddade025e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:41.369263 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1942a58b-3243-4609-bb5f-85ddade025e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1339 microversion: 2.20 time: 0.210161 Jul 12 18:25:41.369263 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 36/68] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:41 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:25:41.437295 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1607ceda-7c6a-4fd6-aabb-82e73e00f79a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:41.438433 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1607ceda-7c6a-4fd6-aabb-82e73e00f79a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:41.468282 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1607ceda-7c6a-4fd6-aabb-82e73e00f79a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:41.471016 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1607ceda-7c6a-4fd6-aabb-82e73e00f79a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:41.473009 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1607ceda-7c6a-4fd6-aabb-82e73e00f79a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:41.473459 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1607ceda-7c6a-4fd6-aabb-82e73e00f79a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:41.552013 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=100 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:41.712978 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1607ceda-7c6a-4fd6-aabb-82e73e00f79a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:41.739654 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1607ceda-7c6a-4fd6-aabb-82e73e00f79a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1296 microversion: 2.1 time: 0.301528 Jul 12 18:25:41.745008 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 37/69] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:41 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1296 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:41.797679 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-ce7114e8-2bc4-48e8-b685-4e8b82e22dfc req-ea12b1dd-bdce-4ec4-ae14-9d5ee7deb4fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39e09137-6e4f-49c6-b4ae-b22209297ca5", "tag": "ea9e2834-7154-4f15-8e8a-4524e64f1d91"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:41.843640 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-ce7114e8-2bc4-48e8-b685-4e8b82e22dfc req-ea12b1dd-bdce-4ec4-ae14-9d5ee7deb4fe service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:41.846744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-ce7114e8-2bc4-48e8-b685-4e8b82e22dfc req-ea12b1dd-bdce-4ec4-ae14-9d5ee7deb4fe service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:41.920445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-ce7114e8-2bc4-48e8-b685-4e8b82e22dfc req-ea12b1dd-bdce-4ec4-ae14-9d5ee7deb4fe service nova] Creating event network-changed:ea9e2834-7154-4f15-8e8a-4524e64f1d91 for instance 39e09137-6e4f-49c6-b4ae-b22209297ca5 on hv-cinder-84488 Jul 12 18:25:41.923849 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-ce7114e8-2bc4-48e8-b685-4e8b82e22dfc req-ea12b1dd-bdce-4ec4-ae14-9d5ee7deb4fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=118411) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 18:25:41.923849 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ee3ffabc-129f-40b9-b15a-fbd832447237 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:41.924678 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ee3ffabc-129f-40b9-b15a-fbd832447237 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:41.926567 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ee3ffabc-129f-40b9-b15a-fbd832447237 None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:41.927177 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ee3ffabc-129f-40b9-b15a-fbd832447237 None None] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:41.942073 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.compute.rpcapi [None req-ee3ffabc-129f-40b9-b15a-fbd832447237 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 18:25:41.944632 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ee3ffabc-129f-40b9-b15a-fbd832447237 None None] Releasing lock "compute-rpcapi-router" {{(pid=118411) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 18:25:42.027039 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ee3ffabc-129f-40b9-b15a-fbd832447237 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256679 Jul 12 18:25:42.027039 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 38/70] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:42.045471 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2202fe23-53b8-4b3d-9072-eacc8463a42a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:42.046272 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2202fe23-53b8-4b3d-9072-eacc8463a42a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:42.063743 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2202fe23-53b8-4b3d-9072-eacc8463a42a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:42.064407 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2202fe23-53b8-4b3d-9072-eacc8463a42a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:42.069719 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2202fe23-53b8-4b3d-9072-eacc8463a42a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:42.070961 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2202fe23-53b8-4b3d-9072-eacc8463a42a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:42.216423 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-82ad9526-5918-4fa4-be1a-c20f2860298a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:42.227619 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-82ad9526-5918-4fa4-be1a-c20f2860298a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 1.785953 Jul 12 18:25:42.258910 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 33/71] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:40 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 1817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:42.377418 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-294d6eeb-14d5-484e-95f0-050ebb1da40d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:42.379900 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-294d6eeb-14d5-484e-95f0-050ebb1da40d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:42.399791 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-294d6eeb-14d5-484e-95f0-050ebb1da40d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:42.400539 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-294d6eeb-14d5-484e-95f0-050ebb1da40d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:42.403184 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-294d6eeb-14d5-484e-95f0-050ebb1da40d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:42.403615 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-294d6eeb-14d5-484e-95f0-050ebb1da40d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:42.477393 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2202fe23-53b8-4b3d-9072-eacc8463a42a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:42.488515 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2202fe23-53b8-4b3d-9072-eacc8463a42a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.461178 Jul 12 18:25:42.490642 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 39/72] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:42 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:42.768075 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8adf119d-354a-487a-9e3f-c9943b34273d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:42.768869 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8adf119d-354a-487a-9e3f-c9943b34273d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:42.794065 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8adf119d-354a-487a-9e3f-c9943b34273d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:42.794462 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8adf119d-354a-487a-9e3f-c9943b34273d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:42.795268 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8adf119d-354a-487a-9e3f-c9943b34273d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:42.795707 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8adf119d-354a-487a-9e3f-c9943b34273d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:42.933398 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8adf119d-354a-487a-9e3f-c9943b34273d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:42.944016 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8adf119d-354a-487a-9e3f-c9943b34273d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1296 microversion: 2.1 time: 0.182307 Jul 12 18:25:42.955541 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 40/73] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:42 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1296 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:43.119040 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-294d6eeb-14d5-484e-95f0-050ebb1da40d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:43.139407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-294d6eeb-14d5-484e-95f0-050ebb1da40d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:43.141981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-294d6eeb-14d5-484e-95f0-050ebb1da40d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:43.149726 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-294d6eeb-14d5-484e-95f0-050ebb1da40d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.774377 Jul 12 18:25:43.167030 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 34/74] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:42 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:43.248115 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5e826f0b-83b4-428f-bb3c-12331c40581e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:43.249488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5e826f0b-83b4-428f-bb3c-12331c40581e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:43.267511 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5e826f0b-83b4-428f-bb3c-12331c40581e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:43.273348 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5e826f0b-83b4-428f-bb3c-12331c40581e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:43.289251 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5e826f0b-83b4-428f-bb3c-12331c40581e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:43.290578 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5e826f0b-83b4-428f-bb3c-12331c40581e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:43.519553 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ec4562a5-4a7f-4715-aa01-754812727e64 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:43.523986 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ec4562a5-4a7f-4715-aa01-754812727e64 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:43.535677 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=16 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:43.538369 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec4562a5-4a7f-4715-aa01-754812727e64 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:43.539231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec4562a5-4a7f-4715-aa01-754812727e64 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:43.541105 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec4562a5-4a7f-4715-aa01-754812727e64 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:43.541900 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec4562a5-4a7f-4715-aa01-754812727e64 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:43.754355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5e826f0b-83b4-428f-bb3c-12331c40581e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:43.771211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5e826f0b-83b4-428f-bb3c-12331c40581e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.527043 Jul 12 18:25:43.785630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 41/75] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:43 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:43.844255 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-d0932998-952f-4167-91c4-79a4d5d8be28 req-cd9fa1d1-c47e-4d32-b257-e9f688807d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa637fee-4d51-4d79-aed2-ed75805784bf", "tag": "2f9bf653-860b-4ebb-ba76-4f6b0284e567"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:43.876616 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-d0932998-952f-4167-91c4-79a4d5d8be28 req-cd9fa1d1-c47e-4d32-b257-e9f688807d28 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:43.881572 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-d0932998-952f-4167-91c4-79a4d5d8be28 req-cd9fa1d1-c47e-4d32-b257-e9f688807d28 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:43.909294 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-d0932998-952f-4167-91c4-79a4d5d8be28 req-cd9fa1d1-c47e-4d32-b257-e9f688807d28 service nova] Creating event network-changed:2f9bf653-860b-4ebb-ba76-4f6b0284e567 for instance fa637fee-4d51-4d79-aed2-ed75805784bf on hv-cinder-84488 Jul 12 18:25:43.927969 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-d0932998-952f-4167-91c4-79a4d5d8be28 req-cd9fa1d1-c47e-4d32-b257-e9f688807d28 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091696 Jul 12 18:25:43.935065 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 42/76] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:43.981786 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-deee0d62-3396-42fc-9204-feb5b0a3f9ec tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:43.982884 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-deee0d62-3396-42fc-9204-feb5b0a3f9ec tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:43.998503 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-deee0d62-3396-42fc-9204-feb5b0a3f9ec tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:43.999569 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-deee0d62-3396-42fc-9204-feb5b0a3f9ec tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:44.000809 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-deee0d62-3396-42fc-9204-feb5b0a3f9ec tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:44.001389 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-deee0d62-3396-42fc-9204-feb5b0a3f9ec tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:44.154348 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-deee0d62-3396-42fc-9204-feb5b0a3f9ec tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:44.172401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-deee0d62-3396-42fc-9204-feb5b0a3f9ec tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1296 microversion: 2.1 time: 0.210593 Jul 12 18:25:44.173251 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 43/77] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:43 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1296 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:44.208085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a0f83753-7ced-48a5-be72-2bd90c37a454 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:44.212566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a0f83753-7ced-48a5-be72-2bd90c37a454 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:44.228086 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a0f83753-7ced-48a5-be72-2bd90c37a454 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:44.229805 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a0f83753-7ced-48a5-be72-2bd90c37a454 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:44.232260 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a0f83753-7ced-48a5-be72-2bd90c37a454 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:44.234703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a0f83753-7ced-48a5-be72-2bd90c37a454 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:44.625349 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a0f83753-7ced-48a5-be72-2bd90c37a454 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:44.654461 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a0f83753-7ced-48a5-be72-2bd90c37a454 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:44.657300 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a0f83753-7ced-48a5-be72-2bd90c37a454 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:44.657990 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a0f83753-7ced-48a5-be72-2bd90c37a454 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.480923 Jul 12 18:25:44.659224 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 44/78] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:44 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:44.801029 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bb9f1dfd-1721-410e-acab-7b386c50cb25 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:44.802065 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-bb9f1dfd-1721-410e-acab-7b386c50cb25 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:44.823434 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bb9f1dfd-1721-410e-acab-7b386c50cb25 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:44.824429 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bb9f1dfd-1721-410e-acab-7b386c50cb25 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:44.826095 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bb9f1dfd-1721-410e-acab-7b386c50cb25 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:44.826658 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bb9f1dfd-1721-410e-acab-7b386c50cb25 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:44.870143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ec4562a5-4a7f-4715-aa01-754812727e64 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:44.879414 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ec4562a5-4a7f-4715-aa01-754812727e64 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 1.376522 Jul 12 18:25:44.879993 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 35/79] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:43 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:45.191609 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b9034130-78ab-41a9-a354-42527b79cd0b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:45.195190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b9034130-78ab-41a9-a354-42527b79cd0b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:45.202602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9034130-78ab-41a9-a354-42527b79cd0b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:45.203041 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9034130-78ab-41a9-a354-42527b79cd0b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:45.208566 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9034130-78ab-41a9-a354-42527b79cd0b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:45.209884 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9034130-78ab-41a9-a354-42527b79cd0b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:45.458376 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=36 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:45.687349 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-bb9f1dfd-1721-410e-acab-7b386c50cb25 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:45.704064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bb9f1dfd-1721-410e-acab-7b386c50cb25 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.915962 Jul 12 18:25:45.721744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 45/80] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:44 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:45.732552 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9d6c04a2-f759-4c6b-b206-3223ab030cea tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:45.741327 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9d6c04a2-f759-4c6b-b206-3223ab030cea tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:45.763967 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d6c04a2-f759-4c6b-b206-3223ab030cea tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:45.763967 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d6c04a2-f759-4c6b-b206-3223ab030cea tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:45.768050 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d6c04a2-f759-4c6b-b206-3223ab030cea tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:45.768998 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d6c04a2-f759-4c6b-b206-3223ab030cea tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:45.896619 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b9034130-78ab-41a9-a354-42527b79cd0b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:45.930968 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b9034130-78ab-41a9-a354-42527b79cd0b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.722318 Jul 12 18:25:45.930968 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 36/81] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:45 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:45.953587 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6cd66515-96c7-4c02-af6b-b53676feb4d3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:45.958987 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6cd66515-96c7-4c02-af6b-b53676feb4d3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:45.981207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cd66515-96c7-4c02-af6b-b53676feb4d3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:45.983306 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cd66515-96c7-4c02-af6b-b53676feb4d3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:45.985767 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cd66515-96c7-4c02-af6b-b53676feb4d3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:45.986223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cd66515-96c7-4c02-af6b-b53676feb4d3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:46.290042 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9d6c04a2-f759-4c6b-b206-3223ab030cea tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:46.334912 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9d6c04a2-f759-4c6b-b206-3223ab030cea tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:46.337673 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9d6c04a2-f759-4c6b-b206-3223ab030cea tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:46.342789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9d6c04a2-f759-4c6b-b206-3223ab030cea tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.617813 Jul 12 18:25:46.344020 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 46/82] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:45 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:46.593792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6cd66515-96c7-4c02-af6b-b53676feb4d3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:46.617664 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6cd66515-96c7-4c02-af6b-b53676feb4d3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.685225 Jul 12 18:25:46.628493 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 37/83] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:45 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:46.730595 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-714dd147-dea6-427d-9664-0a7b8f09894f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:46.736956 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-714dd147-dea6-427d-9664-0a7b8f09894f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:46.740971 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-714dd147-dea6-427d-9664-0a7b8f09894f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:46.741428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-714dd147-dea6-427d-9664-0a7b8f09894f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:46.742205 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-714dd147-dea6-427d-9664-0a7b8f09894f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:46.745753 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-714dd147-dea6-427d-9664-0a7b8f09894f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:46.902727 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-714dd147-dea6-427d-9664-0a7b8f09894f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:46.910744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-714dd147-dea6-427d-9664-0a7b8f09894f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.185061 Jul 12 18:25:46.911693 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 47/84] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:46 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:46.945988 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a4c667f0-6e88-4f60-8c76-3d0592ccaca7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:46.946599 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a4c667f0-6e88-4f60-8c76-3d0592ccaca7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:46.954189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4c667f0-6e88-4f60-8c76-3d0592ccaca7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:46.954635 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4c667f0-6e88-4f60-8c76-3d0592ccaca7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:46.955403 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4c667f0-6e88-4f60-8c76-3d0592ccaca7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:46.955894 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4c667f0-6e88-4f60-8c76-3d0592ccaca7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:47.144730 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a4c667f0-6e88-4f60-8c76-3d0592ccaca7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:47.148806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=99 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:47.153636 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a4c667f0-6e88-4f60-8c76-3d0592ccaca7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.212367 Jul 12 18:25:47.154715 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 38/85] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:46 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:47.306522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-de4c4092-91c3-4004-a75b-c4b101f2b2d6 req-fa35ed1c-998b-4439-b938-9d864278854f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f6ad973-f294-4c83-bb32-5d90270ada90", "tag": "4cea184a-9c42-4328-b0c5-312d0aa3b4e3"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:47.324709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-de4c4092-91c3-4004-a75b-c4b101f2b2d6 req-fa35ed1c-998b-4439-b938-9d864278854f service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:47.328747 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-de4c4092-91c3-4004-a75b-c4b101f2b2d6 req-fa35ed1c-998b-4439-b938-9d864278854f service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:47.361888 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4eb6a57f-bfbf-4d16-96ef-958fea3ec184 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:47.362498 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4eb6a57f-bfbf-4d16-96ef-958fea3ec184 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:47.362984 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-de4c4092-91c3-4004-a75b-c4b101f2b2d6 req-fa35ed1c-998b-4439-b938-9d864278854f service nova] Creating event network-changed:4cea184a-9c42-4328-b0c5-312d0aa3b4e3 for instance 5f6ad973-f294-4c83-bb32-5d90270ada90 on hv-cinder-84488 Jul 12 18:25:47.371399 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:47.375163 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-de4c4092-91c3-4004-a75b-c4b101f2b2d6 req-fa35ed1c-998b-4439-b938-9d864278854f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070246 Jul 12 18:25:47.375491 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4eb6a57f-bfbf-4d16-96ef-958fea3ec184 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:47.376532 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 48/86] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:47.377101 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4eb6a57f-bfbf-4d16-96ef-958fea3ec184 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:47.378289 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4eb6a57f-bfbf-4d16-96ef-958fea3ec184 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:47.378935 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4eb6a57f-bfbf-4d16-96ef-958fea3ec184 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:47.636034 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-60eaa263-5e0f-40bb-b570-bc45297c24db tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:47.637284 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-60eaa263-5e0f-40bb-b570-bc45297c24db tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:47.652144 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-60eaa263-5e0f-40bb-b570-bc45297c24db tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:47.652546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-60eaa263-5e0f-40bb-b570-bc45297c24db tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:47.653472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-60eaa263-5e0f-40bb-b570-bc45297c24db tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:47.656118 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-60eaa263-5e0f-40bb-b570-bc45297c24db tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:47.764283 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4eb6a57f-bfbf-4d16-96ef-958fea3ec184 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:47.774282 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4eb6a57f-bfbf-4d16-96ef-958fea3ec184 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:47.777296 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4eb6a57f-bfbf-4d16-96ef-958fea3ec184 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:47.778197 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4eb6a57f-bfbf-4d16-96ef-958fea3ec184 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.420468 Jul 12 18:25:47.779050 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 39/87] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:47 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:25:47.850222 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-60eaa263-5e0f-40bb-b570-bc45297c24db tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:47.858005 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-60eaa263-5e0f-40bb-b570-bc45297c24db tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.226333 Jul 12 18:25:47.858578 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 49/88] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:47 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:47.927285 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-796a0d3e-b940-478e-91f9-501723fbc5f9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:47.934040 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-796a0d3e-b940-478e-91f9-501723fbc5f9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:47.935538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-796a0d3e-b940-478e-91f9-501723fbc5f9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:47.935988 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-796a0d3e-b940-478e-91f9-501723fbc5f9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:47.937013 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-796a0d3e-b940-478e-91f9-501723fbc5f9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:47.937603 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-796a0d3e-b940-478e-91f9-501723fbc5f9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:48.159448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-796a0d3e-b940-478e-91f9-501723fbc5f9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:48.167987 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-796a0d3e-b940-478e-91f9-501723fbc5f9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.244546 Jul 12 18:25:48.168787 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 40/89] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:47 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:48.171638 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-237aabe0-2c52-4c48-803d-a3c4ac2dbcab tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:48.173278 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-237aabe0-2c52-4c48-803d-a3c4ac2dbcab tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:48.180422 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-237aabe0-2c52-4c48-803d-a3c4ac2dbcab tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:48.180952 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-237aabe0-2c52-4c48-803d-a3c4ac2dbcab tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:48.181791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-237aabe0-2c52-4c48-803d-a3c4ac2dbcab tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:48.182293 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-237aabe0-2c52-4c48-803d-a3c4ac2dbcab tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:48.368340 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-237aabe0-2c52-4c48-803d-a3c4ac2dbcab tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:48.378392 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-237aabe0-2c52-4c48-803d-a3c4ac2dbcab tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.210268 Jul 12 18:25:48.389462 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 50/90] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:48 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:48.797317 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6b4bc099-5aa1-4b89-b458-701ae67f1db8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:48.797927 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6b4bc099-5aa1-4b89-b458-701ae67f1db8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:48.800123 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:48.806341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b4bc099-5aa1-4b89-b458-701ae67f1db8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:48.806941 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b4bc099-5aa1-4b89-b458-701ae67f1db8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:48.809243 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b4bc099-5aa1-4b89-b458-701ae67f1db8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:48.809682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b4bc099-5aa1-4b89-b458-701ae67f1db8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:48.875448 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0bba9397-dc48-43d6-91a6-e01f6fe4e7e7 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:48.876093 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0bba9397-dc48-43d6-91a6-e01f6fe4e7e7 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:48.890243 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0bba9397-dc48-43d6-91a6-e01f6fe4e7e7 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:48.890862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0bba9397-dc48-43d6-91a6-e01f6fe4e7e7 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:48.892732 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0bba9397-dc48-43d6-91a6-e01f6fe4e7e7 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:48.894619 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0bba9397-dc48-43d6-91a6-e01f6fe4e7e7 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:49.023723 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6b4bc099-5aa1-4b89-b458-701ae67f1db8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:49.032500 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6b4bc099-5aa1-4b89-b458-701ae67f1db8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:49.034001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6b4bc099-5aa1-4b89-b458-701ae67f1db8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:49.035332 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6b4bc099-5aa1-4b89-b458-701ae67f1db8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.242039 Jul 12 18:25:49.040871 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 41/91] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:48 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:49.060587 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0bba9397-dc48-43d6-91a6-e01f6fe4e7e7 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:49.068447 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0bba9397-dc48-43d6-91a6-e01f6fe4e7e7 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.196640 Jul 12 18:25:49.069020 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 51/92] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:48 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:49.187363 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9c1b36b4-1186-418b-bef8-73e4d81201c0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:49.187363 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9c1b36b4-1186-418b-bef8-73e4d81201c0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:49.191851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9c1b36b4-1186-418b-bef8-73e4d81201c0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:49.192300 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9c1b36b4-1186-418b-bef8-73e4d81201c0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:49.193436 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9c1b36b4-1186-418b-bef8-73e4d81201c0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:49.193868 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9c1b36b4-1186-418b-bef8-73e4d81201c0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:49.339946 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9c1b36b4-1186-418b-bef8-73e4d81201c0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:49.348851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9c1b36b4-1186-418b-bef8-73e4d81201c0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.167543 Jul 12 18:25:49.350621 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 42/93] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:49 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:49.403251 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-102e8abc-7af1-4a50-94fd-cfbeb89a4229 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:49.404118 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-102e8abc-7af1-4a50-94fd-cfbeb89a4229 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:49.415280 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-102e8abc-7af1-4a50-94fd-cfbeb89a4229 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:49.416052 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-102e8abc-7af1-4a50-94fd-cfbeb89a4229 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:49.417438 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-102e8abc-7af1-4a50-94fd-cfbeb89a4229 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:49.418205 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-102e8abc-7af1-4a50-94fd-cfbeb89a4229 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:49.667584 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-102e8abc-7af1-4a50-94fd-cfbeb89a4229 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:49.680234 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-102e8abc-7af1-4a50-94fd-cfbeb89a4229 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.287694 Jul 12 18:25:49.682901 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 52/94] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:49 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:50.058688 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b81e05c5-4f37-4c3f-9da1-1afd674f5b71 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:50.059288 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b81e05c5-4f37-4c3f-9da1-1afd674f5b71 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:50.067014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b81e05c5-4f37-4c3f-9da1-1afd674f5b71 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:50.067777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b81e05c5-4f37-4c3f-9da1-1afd674f5b71 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:50.068858 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b81e05c5-4f37-4c3f-9da1-1afd674f5b71 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:50.069281 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b81e05c5-4f37-4c3f-9da1-1afd674f5b71 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:50.085959 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-28c9c5e4-5877-4818-a802-9c29bc33b0b6 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:50.086571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-28c9c5e4-5877-4818-a802-9c29bc33b0b6 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:50.096767 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-28c9c5e4-5877-4818-a802-9c29bc33b0b6 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:50.097389 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-28c9c5e4-5877-4818-a802-9c29bc33b0b6 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:50.098310 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-28c9c5e4-5877-4818-a802-9c29bc33b0b6 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:50.098896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-28c9c5e4-5877-4818-a802-9c29bc33b0b6 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:50.239534 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b81e05c5-4f37-4c3f-9da1-1afd674f5b71 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:50.245893 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-28c9c5e4-5877-4818-a802-9c29bc33b0b6 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:50.250197 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b81e05c5-4f37-4c3f-9da1-1afd674f5b71 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:50.252393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b81e05c5-4f37-4c3f-9da1-1afd674f5b71 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:50.253740 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b81e05c5-4f37-4c3f-9da1-1afd674f5b71 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.199746 Jul 12 18:25:50.254145 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-28c9c5e4-5877-4818-a802-9c29bc33b0b6 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.172734 Jul 12 18:25:50.254998 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 53/95] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:50 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:50.260466 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 43/96] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:50 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:50.367475 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e7464010-07e2-44ee-a2d8-16f6091ff13d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:50.368113 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e7464010-07e2-44ee-a2d8-16f6091ff13d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:50.374728 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e7464010-07e2-44ee-a2d8-16f6091ff13d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:50.375528 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e7464010-07e2-44ee-a2d8-16f6091ff13d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:50.376893 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e7464010-07e2-44ee-a2d8-16f6091ff13d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:50.377633 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e7464010-07e2-44ee-a2d8-16f6091ff13d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:50.591276 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e7464010-07e2-44ee-a2d8-16f6091ff13d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:50.597965 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e7464010-07e2-44ee-a2d8-16f6091ff13d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.234860 Jul 12 18:25:50.604582 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 54/97] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:50 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:50.699145 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a4947159-c3bf-4d8e-aa15-cf48eb9ac90e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:50.699697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a4947159-c3bf-4d8e-aa15-cf48eb9ac90e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:50.710664 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4947159-c3bf-4d8e-aa15-cf48eb9ac90e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:50.711604 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4947159-c3bf-4d8e-aa15-cf48eb9ac90e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:50.715379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4947159-c3bf-4d8e-aa15-cf48eb9ac90e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:50.715974 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4947159-c3bf-4d8e-aa15-cf48eb9ac90e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:50.984951 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a4947159-c3bf-4d8e-aa15-cf48eb9ac90e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:50.994851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a4947159-c3bf-4d8e-aa15-cf48eb9ac90e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.299736 Jul 12 18:25:51.005852 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 44/98] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:50 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:51.272055 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bb068801-6e16-4427-81cb-2db89b1390d0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:51.272816 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bb068801-6e16-4427-81cb-2db89b1390d0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:51.275122 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6c2ecde7-ea5e-4f90-aa0a-7fffa7d89fe3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:51.276239 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6c2ecde7-ea5e-4f90-aa0a-7fffa7d89fe3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:51.283635 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6c2ecde7-ea5e-4f90-aa0a-7fffa7d89fe3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:51.283989 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb068801-6e16-4427-81cb-2db89b1390d0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:51.295522 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb068801-6e16-4427-81cb-2db89b1390d0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:51.295778 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6c2ecde7-ea5e-4f90-aa0a-7fffa7d89fe3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:51.295895 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb068801-6e16-4427-81cb-2db89b1390d0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:51.295895 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb068801-6e16-4427-81cb-2db89b1390d0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:51.296439 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6c2ecde7-ea5e-4f90-aa0a-7fffa7d89fe3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:51.297335 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6c2ecde7-ea5e-4f90-aa0a-7fffa7d89fe3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:51.481981 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6c2ecde7-ea5e-4f90-aa0a-7fffa7d89fe3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:51.486316 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=100 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:51.495231 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6c2ecde7-ea5e-4f90-aa0a-7fffa7d89fe3 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.227849 Jul 12 18:25:51.495913 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 55/99] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:51 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:51.537328 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb068801-6e16-4427-81cb-2db89b1390d0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:51.546324 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb068801-6e16-4427-81cb-2db89b1390d0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:51.547852 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb068801-6e16-4427-81cb-2db89b1390d0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:51.549008 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bb068801-6e16-4427-81cb-2db89b1390d0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.281726 Jul 12 18:25:51.549753 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 45/100] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:51 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:51.615211 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0f3c6565-d58a-4ad6-9dd5-c8713244ceee tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:51.615522 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0f3c6565-d58a-4ad6-9dd5-c8713244ceee tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:51.621889 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0f3c6565-d58a-4ad6-9dd5-c8713244ceee tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:51.622697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0f3c6565-d58a-4ad6-9dd5-c8713244ceee tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:51.623720 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0f3c6565-d58a-4ad6-9dd5-c8713244ceee tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:51.624056 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0f3c6565-d58a-4ad6-9dd5-c8713244ceee tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:51.799883 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0f3c6565-d58a-4ad6-9dd5-c8713244ceee tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:51.809892 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0f3c6565-d58a-4ad6-9dd5-c8713244ceee tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.198845 Jul 12 18:25:51.816653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 46/101] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:51 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:51.842507 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-1db7c26a-d991-400f-9515-3c951bc9f594 req-f731e242-4f86-4a59-be4c-20b7425ca42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b08a5b52-4e63-4914-b23c-3818819f7890", "name": "network-vif-plugged", "status": "completed", "tag": "f7fc27cc-a730-4429-a8a5-fde8e8b27309"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:51.851105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-1db7c26a-d991-400f-9515-3c951bc9f594 req-f731e242-4f86-4a59-be4c-20b7425ca42d service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:51.851909 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-1db7c26a-d991-400f-9515-3c951bc9f594 req-f731e242-4f86-4a59-be4c-20b7425ca42d service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:51.864630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-1db7c26a-d991-400f-9515-3c951bc9f594 req-f731e242-4f86-4a59-be4c-20b7425ca42d service nova] Creating event network-vif-plugged:f7fc27cc-a730-4429-a8a5-fde8e8b27309 for instance b08a5b52-4e63-4914-b23c-3818819f7890 on hv-cinder-84488 Jul 12 18:25:51.870756 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-1db7c26a-d991-400f-9515-3c951bc9f594 req-f731e242-4f86-4a59-be4c-20b7425ca42d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.373536 Jul 12 18:25:51.871351 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 56/102] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:52.012539 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-46ed08e8-cb61-493a-860a-57f2064597e7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:52.013598 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-46ed08e8-cb61-493a-860a-57f2064597e7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:52.021559 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ed08e8-cb61-493a-860a-57f2064597e7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:52.022017 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ed08e8-cb61-493a-860a-57f2064597e7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:52.022790 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ed08e8-cb61-493a-860a-57f2064597e7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:52.023223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ed08e8-cb61-493a-860a-57f2064597e7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:52.300838 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-46ed08e8-cb61-493a-860a-57f2064597e7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:52.313211 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-46ed08e8-cb61-493a-860a-57f2064597e7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.304513 Jul 12 18:25:52.317263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 47/103] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:52 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:52.513242 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4d3b58bb-aac5-4632-9482-0e5382418ccb tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:52.513928 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4d3b58bb-aac5-4632-9482-0e5382418ccb tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:52.528993 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=4 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:52.531947 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d3b58bb-aac5-4632-9482-0e5382418ccb tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:52.532566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d3b58bb-aac5-4632-9482-0e5382418ccb tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:52.533522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d3b58bb-aac5-4632-9482-0e5382418ccb tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:52.534101 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d3b58bb-aac5-4632-9482-0e5382418ccb tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:52.566847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ba2dbd5a-9e8c-40e7-80ab-2fb0287a9e3b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:52.567719 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ba2dbd5a-9e8c-40e7-80ab-2fb0287a9e3b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:52.579647 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ba2dbd5a-9e8c-40e7-80ab-2fb0287a9e3b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:52.581923 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ba2dbd5a-9e8c-40e7-80ab-2fb0287a9e3b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:52.588584 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ba2dbd5a-9e8c-40e7-80ab-2fb0287a9e3b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:52.589189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ba2dbd5a-9e8c-40e7-80ab-2fb0287a9e3b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:52.790061 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4d3b58bb-aac5-4632-9482-0e5382418ccb tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:52.799114 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4d3b58bb-aac5-4632-9482-0e5382418ccb tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.290054 Jul 12 18:25:52.800017 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 57/104] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:52 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:52.826386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9ec828a0-af40-410d-8b9c-08399506e18a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:52.827003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9ec828a0-af40-410d-8b9c-08399506e18a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:52.841551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9ec828a0-af40-410d-8b9c-08399506e18a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:52.847336 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9ec828a0-af40-410d-8b9c-08399506e18a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:52.847336 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9ec828a0-af40-410d-8b9c-08399506e18a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:52.847336 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9ec828a0-af40-410d-8b9c-08399506e18a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:53.021048 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ba2dbd5a-9e8c-40e7-80ab-2fb0287a9e3b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:53.031799 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ba2dbd5a-9e8c-40e7-80ab-2fb0287a9e3b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:53.035366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ba2dbd5a-9e8c-40e7-80ab-2fb0287a9e3b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:53.037295 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ba2dbd5a-9e8c-40e7-80ab-2fb0287a9e3b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.474230 Jul 12 18:25:53.048043 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 48/105] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:52 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:53.085047 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9ec828a0-af40-410d-8b9c-08399506e18a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:53.095326 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9ec828a0-af40-410d-8b9c-08399506e18a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.272715 Jul 12 18:25:53.103290 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 58/106] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:52 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:53.336214 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-038c9cbd-4b87-4a05-b319-c63526f12243 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:53.338278 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-038c9cbd-4b87-4a05-b319-c63526f12243 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:53.345387 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-038c9cbd-4b87-4a05-b319-c63526f12243 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:53.345934 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-038c9cbd-4b87-4a05-b319-c63526f12243 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:53.346801 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-038c9cbd-4b87-4a05-b319-c63526f12243 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:53.347432 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-038c9cbd-4b87-4a05-b319-c63526f12243 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:53.499920 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-038c9cbd-4b87-4a05-b319-c63526f12243 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:53.515200 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-038c9cbd-4b87-4a05-b319-c63526f12243 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.183177 Jul 12 18:25:53.516947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 49/107] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:53 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:53.816702 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-24bea450-6072-499b-a70e-f4ce7450b4e4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:53.817311 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-24bea450-6072-499b-a70e-f4ce7450b4e4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:53.838261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-24bea450-6072-499b-a70e-f4ce7450b4e4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:53.839096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-24bea450-6072-499b-a70e-f4ce7450b4e4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:53.839393 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-24bea450-6072-499b-a70e-f4ce7450b4e4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:53.839927 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-24bea450-6072-499b-a70e-f4ce7450b4e4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:53.891950 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-81fea18e-9642-4d21-ae32-0db5e9ab962c req-d5cab692-b054-4932-a0d9-cc552c473f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e09137-6e4f-49c6-b4ae-b22209297ca5", "name": "network-vif-plugged", "status": "completed", "tag": "ea9e2834-7154-4f15-8e8a-4524e64f1d91"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:53.903423 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-81fea18e-9642-4d21-ae32-0db5e9ab962c req-d5cab692-b054-4932-a0d9-cc552c473f47 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:53.903857 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-81fea18e-9642-4d21-ae32-0db5e9ab962c req-d5cab692-b054-4932-a0d9-cc552c473f47 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:53.916607 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-81fea18e-9642-4d21-ae32-0db5e9ab962c req-d5cab692-b054-4932-a0d9-cc552c473f47 service nova] Creating event network-vif-plugged:ea9e2834-7154-4f15-8e8a-4524e64f1d91 for instance 39e09137-6e4f-49c6-b4ae-b22209297ca5 on hv-cinder-84488 Jul 12 18:25:53.921728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-81fea18e-9642-4d21-ae32-0db5e9ab962c req-d5cab692-b054-4932-a0d9-cc552c473f47 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036849 Jul 12 18:25:53.922349 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 50/108] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:25:53.983691 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-24bea450-6072-499b-a70e-f4ce7450b4e4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:53.992390 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-24bea450-6072-499b-a70e-f4ce7450b4e4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.179948 Jul 12 18:25:54.004476 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 59/109] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:53 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:54.058777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-81c98cba-8c87-4f6a-9db0-8088af34cde2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:54.059545 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-81c98cba-8c87-4f6a-9db0-8088af34cde2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:54.066136 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-81c98cba-8c87-4f6a-9db0-8088af34cde2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:54.066634 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-81c98cba-8c87-4f6a-9db0-8088af34cde2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:54.067625 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-81c98cba-8c87-4f6a-9db0-8088af34cde2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:54.068931 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-81c98cba-8c87-4f6a-9db0-8088af34cde2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:54.119599 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f1e311bd-46ce-48be-9f02-239cc6246c28 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:54.120566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f1e311bd-46ce-48be-9f02-239cc6246c28 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:54.127231 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f1e311bd-46ce-48be-9f02-239cc6246c28 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:54.127923 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f1e311bd-46ce-48be-9f02-239cc6246c28 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:54.128824 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f1e311bd-46ce-48be-9f02-239cc6246c28 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:54.129492 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f1e311bd-46ce-48be-9f02-239cc6246c28 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:54.335168 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-81c98cba-8c87-4f6a-9db0-8088af34cde2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:54.343237 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f1e311bd-46ce-48be-9f02-239cc6246c28 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:54.345914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-81c98cba-8c87-4f6a-9db0-8088af34cde2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:54.347423 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-81c98cba-8c87-4f6a-9db0-8088af34cde2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:54.356130 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-81c98cba-8c87-4f6a-9db0-8088af34cde2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.297387 Jul 12 18:25:54.357282 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 51/110] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:54 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:54.361643 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f1e311bd-46ce-48be-9f02-239cc6246c28 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.247399 Jul 12 18:25:54.375087 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 60/111] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:54 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:54.533494 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c3e420d7-f3f4-4dec-84d0-9bfade4107ea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:54.534342 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c3e420d7-f3f4-4dec-84d0-9bfade4107ea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:54.545153 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3e420d7-f3f4-4dec-84d0-9bfade4107ea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:54.545153 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3e420d7-f3f4-4dec-84d0-9bfade4107ea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:54.545868 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3e420d7-f3f4-4dec-84d0-9bfade4107ea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:54.551430 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3e420d7-f3f4-4dec-84d0-9bfade4107ea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:54.704939 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c3e420d7-f3f4-4dec-84d0-9bfade4107ea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:54.712900 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c3e420d7-f3f4-4dec-84d0-9bfade4107ea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.184182 Jul 12 18:25:54.713466 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 52/112] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:54 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:55.009473 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b37e6f6f-7991-49af-a427-4565f783f52f tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:55.010085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b37e6f6f-7991-49af-a427-4565f783f52f tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:55.016161 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b37e6f6f-7991-49af-a427-4565f783f52f tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:55.016641 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b37e6f6f-7991-49af-a427-4565f783f52f tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:55.017402 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b37e6f6f-7991-49af-a427-4565f783f52f tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:55.017834 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b37e6f6f-7991-49af-a427-4565f783f52f tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:55.151953 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b37e6f6f-7991-49af-a427-4565f783f52f tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:55.160561 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b37e6f6f-7991-49af-a427-4565f783f52f tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.153904 Jul 12 18:25:55.160561 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 61/113] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:55 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:55.374961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a9e0d55d-721a-4fb7-8744-b4c484d6d5bc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:55.375614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a9e0d55d-721a-4fb7-8744-b4c484d6d5bc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:55.379105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-10fe4b0c-d598-4362-96ac-2dbb8ddabf41 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:55.379788 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-10fe4b0c-d598-4362-96ac-2dbb8ddabf41 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:55.382473 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9e0d55d-721a-4fb7-8744-b4c484d6d5bc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:55.389289 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9e0d55d-721a-4fb7-8744-b4c484d6d5bc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:55.389289 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9e0d55d-721a-4fb7-8744-b4c484d6d5bc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:55.389289 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9e0d55d-721a-4fb7-8744-b4c484d6d5bc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:55.389643 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-10fe4b0c-d598-4362-96ac-2dbb8ddabf41 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:55.389643 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-10fe4b0c-d598-4362-96ac-2dbb8ddabf41 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:55.390085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-10fe4b0c-d598-4362-96ac-2dbb8ddabf41 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:55.390558 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-10fe4b0c-d598-4362-96ac-2dbb8ddabf41 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:55.533697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a9e0d55d-721a-4fb7-8744-b4c484d6d5bc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:55.543277 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a9e0d55d-721a-4fb7-8744-b4c484d6d5bc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:55.544776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a9e0d55d-721a-4fb7-8744-b4c484d6d5bc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:55.545905 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a9e0d55d-721a-4fb7-8744-b4c484d6d5bc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.174917 Jul 12 18:25:55.546468 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 53/114] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:55 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:55.546607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-10fe4b0c-d598-4362-96ac-2dbb8ddabf41 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:55.554378 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-10fe4b0c-d598-4362-96ac-2dbb8ddabf41 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.179221 Jul 12 18:25:55.555031 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 62/115] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:55 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:55.730768 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3b3ed394-2758-4cab-ada4-fae61e9c8eee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:55.731390 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3b3ed394-2758-4cab-ada4-fae61e9c8eee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:55.737934 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b3ed394-2758-4cab-ada4-fae61e9c8eee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:55.738408 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b3ed394-2758-4cab-ada4-fae61e9c8eee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:55.739124 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b3ed394-2758-4cab-ada4-fae61e9c8eee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:55.739553 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b3ed394-2758-4cab-ada4-fae61e9c8eee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:55.884926 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3b3ed394-2758-4cab-ada4-fae61e9c8eee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:55.894837 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3b3ed394-2758-4cab-ada4-fae61e9c8eee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.166145 Jul 12 18:25:55.894837 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 54/116] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:55 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:55.939174 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-064aa057-a944-466b-8391-25de4da25aa1 req-b03155e6-4ed7-4e11-b5f7-9992b0c1338e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2004c12c-256b-47fa-a5bf-9517bcc06b57", "name": "network-vif-plugged", "status": "completed", "tag": "43bea616-9f1c-4981-ad8a-ef451790c6d4"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:25:55.946536 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-064aa057-a944-466b-8391-25de4da25aa1 req-b03155e6-4ed7-4e11-b5f7-9992b0c1338e service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:55.946989 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-064aa057-a944-466b-8391-25de4da25aa1 req-b03155e6-4ed7-4e11-b5f7-9992b0c1338e service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:55.958730 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-064aa057-a944-466b-8391-25de4da25aa1 req-b03155e6-4ed7-4e11-b5f7-9992b0c1338e service nova] Creating event network-vif-plugged:43bea616-9f1c-4981-ad8a-ef451790c6d4 for instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 on hv-cinder-84488 Jul 12 18:25:55.964035 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-064aa057-a944-466b-8391-25de4da25aa1 req-b03155e6-4ed7-4e11-b5f7-9992b0c1338e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030599 Jul 12 18:25:55.964668 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 63/117] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:25:56.176775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9d5aea89-88b1-4d7c-afb7-a9fe156a5cec tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:56.177950 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9d5aea89-88b1-4d7c-afb7-a9fe156a5cec tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:56.187516 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d5aea89-88b1-4d7c-afb7-a9fe156a5cec tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:56.187997 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d5aea89-88b1-4d7c-afb7-a9fe156a5cec tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:56.188932 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d5aea89-88b1-4d7c-afb7-a9fe156a5cec tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:56.189308 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d5aea89-88b1-4d7c-afb7-a9fe156a5cec tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:56.347523 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9d5aea89-88b1-4d7c-afb7-a9fe156a5cec tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:56.356678 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9d5aea89-88b1-4d7c-afb7-a9fe156a5cec tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.183917 Jul 12 18:25:56.357259 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 55/118] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:56 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:56.564215 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-66514e6f-7881-46df-9c4e-a32ddec9a521 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:56.567919 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-66514e6f-7881-46df-9c4e-a32ddec9a521 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:56.571195 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a35d7e70-33d1-4bf5-9f59-448785503b10 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:56.571636 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-66514e6f-7881-46df-9c4e-a32ddec9a521 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:56.571739 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-66514e6f-7881-46df-9c4e-a32ddec9a521 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:56.571975 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a35d7e70-33d1-4bf5-9f59-448785503b10 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:56.572585 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-66514e6f-7881-46df-9c4e-a32ddec9a521 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:56.573028 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-66514e6f-7881-46df-9c4e-a32ddec9a521 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:56.578366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a35d7e70-33d1-4bf5-9f59-448785503b10 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:56.578837 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a35d7e70-33d1-4bf5-9f59-448785503b10 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:56.579605 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a35d7e70-33d1-4bf5-9f59-448785503b10 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:56.580045 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a35d7e70-33d1-4bf5-9f59-448785503b10 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:56.584251 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:56.723252 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a35d7e70-33d1-4bf5-9f59-448785503b10 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:56.743730 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a35d7e70-33d1-4bf5-9f59-448785503b10 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.176314 Jul 12 18:25:56.745098 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 56/119] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:56 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:56.749462 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-66514e6f-7881-46df-9c4e-a32ddec9a521 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:56.760165 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-66514e6f-7881-46df-9c4e-a32ddec9a521 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:56.760347 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-66514e6f-7881-46df-9c4e-a32ddec9a521 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:56.761427 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-66514e6f-7881-46df-9c4e-a32ddec9a521 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.201625 Jul 12 18:25:56.761992 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 64/120] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:56 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:56.910127 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-25d33c65-a80d-4d62-b9f0-37b07952868d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:56.910743 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-25d33c65-a80d-4d62-b9f0-37b07952868d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:56.918224 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25d33c65-a80d-4d62-b9f0-37b07952868d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:56.918722 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25d33c65-a80d-4d62-b9f0-37b07952868d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:56.919415 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25d33c65-a80d-4d62-b9f0-37b07952868d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:56.919918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25d33c65-a80d-4d62-b9f0-37b07952868d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:57.057338 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-25d33c65-a80d-4d62-b9f0-37b07952868d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:57.065317 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-25d33c65-a80d-4d62-b9f0-37b07952868d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.159030 Jul 12 18:25:57.065883 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 57/121] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:56 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:57.374910 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5ec07e49-31e8-4078-a3df-fe790e15be4e tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:57.375609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5ec07e49-31e8-4078-a3df-fe790e15be4e tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:57.383037 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5ec07e49-31e8-4078-a3df-fe790e15be4e tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:57.383504 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5ec07e49-31e8-4078-a3df-fe790e15be4e tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:57.384376 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5ec07e49-31e8-4078-a3df-fe790e15be4e tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:57.385031 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5ec07e49-31e8-4078-a3df-fe790e15be4e tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:57.557274 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5ec07e49-31e8-4078-a3df-fe790e15be4e tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:57.569667 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5ec07e49-31e8-4078-a3df-fe790e15be4e tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.195409 Jul 12 18:25:57.571165 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 65/122] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:57 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:57.760415 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8add9cbb-1cfc-4d92-9695-119793858db4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:57.761230 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8add9cbb-1cfc-4d92-9695-119793858db4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:57.779449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8add9cbb-1cfc-4d92-9695-119793858db4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:57.779449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8add9cbb-1cfc-4d92-9695-119793858db4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:57.779449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8add9cbb-1cfc-4d92-9695-119793858db4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:57.779449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8add9cbb-1cfc-4d92-9695-119793858db4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:57.780205 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3e05c10e-0d21-412c-9271-0ec37e7c59d7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:57.781037 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3e05c10e-0d21-412c-9271-0ec37e7c59d7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:57.790402 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3e05c10e-0d21-412c-9271-0ec37e7c59d7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:57.793214 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3e05c10e-0d21-412c-9271-0ec37e7c59d7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:57.794075 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3e05c10e-0d21-412c-9271-0ec37e7c59d7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:57.794527 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3e05c10e-0d21-412c-9271-0ec37e7c59d7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:57.976409 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3e05c10e-0d21-412c-9271-0ec37e7c59d7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:57.985189 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3e05c10e-0d21-412c-9271-0ec37e7c59d7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:57.987401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3e05c10e-0d21-412c-9271-0ec37e7c59d7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:57.987583 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8add9cbb-1cfc-4d92-9695-119793858db4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:57.988624 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3e05c10e-0d21-412c-9271-0ec37e7c59d7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.212434 Jul 12 18:25:57.989204 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 66/123] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:57 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:58.011388 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8add9cbb-1cfc-4d92-9695-119793858db4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.254629 Jul 12 18:25:58.012397 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 58/124] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:57 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:58.082757 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-97a655ae-c033-484a-b156-162812be5c6b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:58.084411 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-97a655ae-c033-484a-b156-162812be5c6b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:58.091087 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97a655ae-c033-484a-b156-162812be5c6b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:58.091535 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97a655ae-c033-484a-b156-162812be5c6b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:58.092327 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97a655ae-c033-484a-b156-162812be5c6b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:58.092779 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97a655ae-c033-484a-b156-162812be5c6b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:58.246660 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-97a655ae-c033-484a-b156-162812be5c6b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:58.262380 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-97a655ae-c033-484a-b156-162812be5c6b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.183539 Jul 12 18:25:58.272372 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 67/125] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:58 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:58.589589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f9a5bb05-d79b-496a-8187-00609e6e401a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:58.590371 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f9a5bb05-d79b-496a-8187-00609e6e401a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:58.599582 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9a5bb05-d79b-496a-8187-00609e6e401a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:58.599582 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9a5bb05-d79b-496a-8187-00609e6e401a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:58.599582 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9a5bb05-d79b-496a-8187-00609e6e401a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:58.599582 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9a5bb05-d79b-496a-8187-00609e6e401a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:58.774040 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f9a5bb05-d79b-496a-8187-00609e6e401a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:58.781826 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f9a5bb05-d79b-496a-8187-00609e6e401a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.195956 Jul 12 18:25:58.782418 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 59/126] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:58 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:59.007173 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6098eec8-982b-43bd-a332-7348ebc3cf29 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:59.007770 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6098eec8-982b-43bd-a332-7348ebc3cf29 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:59.013756 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6098eec8-982b-43bd-a332-7348ebc3cf29 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:59.014286 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6098eec8-982b-43bd-a332-7348ebc3cf29 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:59.015038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6098eec8-982b-43bd-a332-7348ebc3cf29 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:59.015463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6098eec8-982b-43bd-a332-7348ebc3cf29 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:59.037908 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-239d0a8a-e5d6-40a5-9878-88ce31eda6c7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:59.037908 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-239d0a8a-e5d6-40a5-9878-88ce31eda6c7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:59.046980 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-239d0a8a-e5d6-40a5-9878-88ce31eda6c7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:59.048029 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-239d0a8a-e5d6-40a5-9878-88ce31eda6c7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:59.049408 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-239d0a8a-e5d6-40a5-9878-88ce31eda6c7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:59.049892 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-239d0a8a-e5d6-40a5-9878-88ce31eda6c7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:59.197762 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-239d0a8a-e5d6-40a5-9878-88ce31eda6c7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:59.203175 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-239d0a8a-e5d6-40a5-9878-88ce31eda6c7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.176764 Jul 12 18:25:59.203761 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 60/127] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:59 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:25:59.227917 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6098eec8-982b-43bd-a332-7348ebc3cf29 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:59.237325 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6098eec8-982b-43bd-a332-7348ebc3cf29 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:59.238922 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6098eec8-982b-43bd-a332-7348ebc3cf29 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:59.240782 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6098eec8-982b-43bd-a332-7348ebc3cf29 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.237662 Jul 12 18:25:59.241418 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 68/128] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:25:59 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:25:59.285072 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-db0b979e-c542-4192-9c52-345d9fca04b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:59.285946 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-db0b979e-c542-4192-9c52-345d9fca04b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:59.293559 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db0b979e-c542-4192-9c52-345d9fca04b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:59.294076 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db0b979e-c542-4192-9c52-345d9fca04b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:59.295030 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db0b979e-c542-4192-9c52-345d9fca04b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:59.296441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db0b979e-c542-4192-9c52-345d9fca04b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:59.542324 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-db0b979e-c542-4192-9c52-345d9fca04b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:59.550207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-db0b979e-c542-4192-9c52-345d9fca04b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.269788 Jul 12 18:25:59.550787 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 61/129] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:59 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:25:59.800552 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e4f4295e-8df5-4f8a-8a31-19bc9bc43e23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:25:59.801123 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e4f4295e-8df5-4f8a-8a31-19bc9bc43e23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:25:59.808151 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e4f4295e-8df5-4f8a-8a31-19bc9bc43e23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:59.808620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e4f4295e-8df5-4f8a-8a31-19bc9bc43e23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:59.809386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e4f4295e-8df5-4f8a-8a31-19bc9bc43e23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:25:59.809821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e4f4295e-8df5-4f8a-8a31-19bc9bc43e23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:25:59.959639 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e4f4295e-8df5-4f8a-8a31-19bc9bc43e23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:25:59.972936 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e4f4295e-8df5-4f8a-8a31-19bc9bc43e23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.175552 Jul 12 18:25:59.986620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 69/130] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:25:59 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:00.220914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a0173ab0-e4b0-42a3-b5bc-71b6ee752835 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:00.221524 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a0173ab0-e4b0-42a3-b5bc-71b6ee752835 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:00.228408 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a0173ab0-e4b0-42a3-b5bc-71b6ee752835 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:00.228858 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a0173ab0-e4b0-42a3-b5bc-71b6ee752835 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:00.230160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a0173ab0-e4b0-42a3-b5bc-71b6ee752835 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:00.230598 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a0173ab0-e4b0-42a3-b5bc-71b6ee752835 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:00.268405 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c9a9898d-e3ed-4901-81fa-2c2598a12253 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:00.268405 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c9a9898d-e3ed-4901-81fa-2c2598a12253 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:00.280762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c9a9898d-e3ed-4901-81fa-2c2598a12253 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:00.281559 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c9a9898d-e3ed-4901-81fa-2c2598a12253 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:00.282594 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c9a9898d-e3ed-4901-81fa-2c2598a12253 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:00.283241 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c9a9898d-e3ed-4901-81fa-2c2598a12253 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:00.407206 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a0173ab0-e4b0-42a3-b5bc-71b6ee752835 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:00.419105 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a0173ab0-e4b0-42a3-b5bc-71b6ee752835 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.201967 Jul 12 18:26:00.419947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 62/131] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:00 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:00.451308 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c9a9898d-e3ed-4901-81fa-2c2598a12253 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:00.469806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c9a9898d-e3ed-4901-81fa-2c2598a12253 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:00.469806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c9a9898d-e3ed-4901-81fa-2c2598a12253 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:00.469806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c9a9898d-e3ed-4901-81fa-2c2598a12253 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.213096 Jul 12 18:26:00.470613 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 70/132] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:26:00 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:26:00.575554 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b1c165ce-1f36-4afb-96d3-83681128fcf8 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:00.576384 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b1c165ce-1f36-4afb-96d3-83681128fcf8 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:00.584173 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1c165ce-1f36-4afb-96d3-83681128fcf8 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:00.584723 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1c165ce-1f36-4afb-96d3-83681128fcf8 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:00.585508 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1c165ce-1f36-4afb-96d3-83681128fcf8 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:00.586028 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1c165ce-1f36-4afb-96d3-83681128fcf8 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:00.758772 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b1c165ce-1f36-4afb-96d3-83681128fcf8 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:00.781552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b1c165ce-1f36-4afb-96d3-83681128fcf8 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.195749 Jul 12 18:26:00.781552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 63/133] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:00 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:00.828098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-b013544e-726b-4084-b434-8925da43d893 req-08af8834-06bb-4b43-bf10-018fb545ba7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6ad973-f294-4c83-bb32-5d90270ada90", "name": "network-vif-plugged", "status": "completed", "tag": "4cea184a-9c42-4328-b0c5-312d0aa3b4e3"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:26:00.841909 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-b013544e-726b-4084-b434-8925da43d893 req-08af8834-06bb-4b43-bf10-018fb545ba7a service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:00.841909 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-b013544e-726b-4084-b434-8925da43d893 req-08af8834-06bb-4b43-bf10-018fb545ba7a service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:00.850956 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-b013544e-726b-4084-b434-8925da43d893 req-08af8834-06bb-4b43-bf10-018fb545ba7a service nova] Creating event network-vif-plugged:4cea184a-9c42-4328-b0c5-312d0aa3b4e3 for instance 5f6ad973-f294-4c83-bb32-5d90270ada90 on hv-cinder-84488 Jul 12 18:26:00.856464 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-b013544e-726b-4084-b434-8925da43d893 req-08af8834-06bb-4b43-bf10-018fb545ba7a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033649 Jul 12 18:26:00.857328 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 71/134] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:26:01.005583 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-62f5ad09-5e15-4cf7-80b0-0038b443817d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:01.006731 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-62f5ad09-5e15-4cf7-80b0-0038b443817d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:01.015659 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-62f5ad09-5e15-4cf7-80b0-0038b443817d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:01.016564 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-62f5ad09-5e15-4cf7-80b0-0038b443817d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:01.018610 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-62f5ad09-5e15-4cf7-80b0-0038b443817d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:01.019242 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-62f5ad09-5e15-4cf7-80b0-0038b443817d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:01.164882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-62f5ad09-5e15-4cf7-80b0-0038b443817d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:01.172261 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-62f5ad09-5e15-4cf7-80b0-0038b443817d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.173193 Jul 12 18:26:01.172890 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 64/135] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:00 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:01.437184 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f26cbe9d-830f-4b38-86f2-efe8e444ca44 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:01.438434 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f26cbe9d-830f-4b38-86f2-efe8e444ca44 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:01.446112 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f26cbe9d-830f-4b38-86f2-efe8e444ca44 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:01.446935 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f26cbe9d-830f-4b38-86f2-efe8e444ca44 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:01.447989 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f26cbe9d-830f-4b38-86f2-efe8e444ca44 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:01.448917 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f26cbe9d-830f-4b38-86f2-efe8e444ca44 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:01.486324 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9b889c7e-576f-4bb1-8152-82ccf5572bf4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:01.488274 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9b889c7e-576f-4bb1-8152-82ccf5572bf4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:01.506223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b889c7e-576f-4bb1-8152-82ccf5572bf4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:01.511790 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b889c7e-576f-4bb1-8152-82ccf5572bf4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:01.512849 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b889c7e-576f-4bb1-8152-82ccf5572bf4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:01.518170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b889c7e-576f-4bb1-8152-82ccf5572bf4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:01.688244 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f26cbe9d-830f-4b38-86f2-efe8e444ca44 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:01.701620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f26cbe9d-830f-4b38-86f2-efe8e444ca44 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1322 microversion: 2.1 time: 0.268894 Jul 12 18:26:01.702676 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 72/136] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:01 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:01.783816 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9b889c7e-576f-4bb1-8152-82ccf5572bf4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:01.788535 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-20beacad-645a-46bc-bf0f-7033afc29add tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:01.789228 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-20beacad-645a-46bc-bf0f-7033afc29add tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:01.794296 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9b889c7e-576f-4bb1-8152-82ccf5572bf4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:01.796398 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20beacad-645a-46bc-bf0f-7033afc29add tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:01.796960 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20beacad-645a-46bc-bf0f-7033afc29add tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:01.797731 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20beacad-645a-46bc-bf0f-7033afc29add tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:01.798161 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20beacad-645a-46bc-bf0f-7033afc29add tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:01.799758 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9b889c7e-576f-4bb1-8152-82ccf5572bf4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:01.801272 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9b889c7e-576f-4bb1-8152-82ccf5572bf4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.319261 Jul 12 18:26:01.803355 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 65/137] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:26:01 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:26:02.005065 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-20beacad-645a-46bc-bf0f-7033afc29add tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:02.013340 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-20beacad-645a-46bc-bf0f-7033afc29add tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.228803 Jul 12 18:26:02.013921 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 73/138] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:01 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:26:02.189127 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8b7f6597-7292-4ed4-bcbd-2cb5ce73016a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:02.189709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8b7f6597-7292-4ed4-bcbd-2cb5ce73016a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:02.196380 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8b7f6597-7292-4ed4-bcbd-2cb5ce73016a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:02.196842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8b7f6597-7292-4ed4-bcbd-2cb5ce73016a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:02.197600 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8b7f6597-7292-4ed4-bcbd-2cb5ce73016a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:02.198021 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8b7f6597-7292-4ed4-bcbd-2cb5ce73016a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:02.362190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8b7f6597-7292-4ed4-bcbd-2cb5ce73016a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:02.371980 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8b7f6597-7292-4ed4-bcbd-2cb5ce73016a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1315 microversion: 2.1 time: 0.186576 Jul 12 18:26:02.372604 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 66/139] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:02 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:02.725377 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-22691559-6f76-4708-93ea-7931e2d3b0ea tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:02.725377 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-22691559-6f76-4708-93ea-7931e2d3b0ea tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:02.725377 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:02.727331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-22691559-6f76-4708-93ea-7931e2d3b0ea tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:02.727788 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-22691559-6f76-4708-93ea-7931e2d3b0ea tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:02.728612 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-22691559-6f76-4708-93ea-7931e2d3b0ea tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:02.729059 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-22691559-6f76-4708-93ea-7931e2d3b0ea tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:02.753904 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=100 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:02.822300 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d12f70cb-19d8-44cc-a390-1d58f28667d2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:02.823893 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d12f70cb-19d8-44cc-a390-1d58f28667d2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:02.830545 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d12f70cb-19d8-44cc-a390-1d58f28667d2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:02.832667 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d12f70cb-19d8-44cc-a390-1d58f28667d2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:02.832667 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d12f70cb-19d8-44cc-a390-1d58f28667d2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:02.832667 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d12f70cb-19d8-44cc-a390-1d58f28667d2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:02.898422 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-22691559-6f76-4708-93ea-7931e2d3b0ea tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:02.906496 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-22691559-6f76-4708-93ea-7931e2d3b0ea tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1516 microversion: 2.1 time: 0.191368 Jul 12 18:26:02.907102 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 74/140] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:02 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:02.912684 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-60556747-c7ae-437d-807c-d508be6c0a4a req-2ea0425a-2fc4-45ec-88fe-838085340e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa637fee-4d51-4d79-aed2-ed75805784bf", "name": "network-vif-plugged", "status": "completed", "tag": "2f9bf653-860b-4ebb-ba76-4f6b0284e567"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:26:02.925576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-60556747-c7ae-437d-807c-d508be6c0a4a req-2ea0425a-2fc4-45ec-88fe-838085340e8d service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:02.926123 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-60556747-c7ae-437d-807c-d508be6c0a4a req-2ea0425a-2fc4-45ec-88fe-838085340e8d service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:02.939413 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-60556747-c7ae-437d-807c-d508be6c0a4a req-2ea0425a-2fc4-45ec-88fe-838085340e8d service nova] Creating event network-vif-plugged:2f9bf653-860b-4ebb-ba76-4f6b0284e567 for instance fa637fee-4d51-4d79-aed2-ed75805784bf on hv-cinder-84488 Jul 12 18:26:02.944747 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-60556747-c7ae-437d-807c-d508be6c0a4a req-2ea0425a-2fc4-45ec-88fe-838085340e8d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036420 Jul 12 18:26:02.945567 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 75/141] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:26:02.952080 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9c52bede-185f-4b9e-8c73-7d46f89d01ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:26:02.953340 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9c52bede-185f-4b9e-8c73-7d46f89d01ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:02.963910 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9c52bede-185f-4b9e-8c73-7d46f89d01ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:02.964388 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9c52bede-185f-4b9e-8c73-7d46f89d01ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:02.965168 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9c52bede-185f-4b9e-8c73-7d46f89d01ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:02.965768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9c52bede-185f-4b9e-8c73-7d46f89d01ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:02.972167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d12f70cb-19d8-44cc-a390-1d58f28667d2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:02.982094 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d12f70cb-19d8-44cc-a390-1d58f28667d2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:02.983842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d12f70cb-19d8-44cc-a390-1d58f28667d2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:02.985350 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d12f70cb-19d8-44cc-a390-1d58f28667d2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.168494 Jul 12 18:26:02.985912 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 67/142] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:26:02 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:26:03.029772 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-9c52bede-185f-4b9e-8c73-7d46f89d01ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lazy-loading 'flavor' on Instance uuid 39e09137-6e4f-49c6-b4ae-b22209297ca5 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:26:03.031919 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-eed6145f-fd77-428c-a5c2-4bb52639a3d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:03.032863 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-eed6145f-fd77-428c-a5c2-4bb52639a3d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:03.041668 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eed6145f-fd77-428c-a5c2-4bb52639a3d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:03.042280 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eed6145f-fd77-428c-a5c2-4bb52639a3d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:03.043413 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eed6145f-fd77-428c-a5c2-4bb52639a3d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:03.043861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eed6145f-fd77-428c-a5c2-4bb52639a3d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:03.191210 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-eed6145f-fd77-428c-a5c2-4bb52639a3d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:03.199743 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-eed6145f-fd77-428c-a5c2-4bb52639a3d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.173216 Jul 12 18:26:03.200557 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 68/143] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:03 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:26:03.394496 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3c9c23c6-a93b-4e64-827b-10f0f0db38a4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:03.399339 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3c9c23c6-a93b-4e64-827b-10f0f0db38a4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:03.408979 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c9c23c6-a93b-4e64-827b-10f0f0db38a4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:03.418108 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c9c23c6-a93b-4e64-827b-10f0f0db38a4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:03.419059 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c9c23c6-a93b-4e64-827b-10f0f0db38a4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:03.419617 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c9c23c6-a93b-4e64-827b-10f0f0db38a4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:03.576252 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9c52bede-185f-4b9e-8c73-7d46f89d01ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "POST /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5/action" status: 200 len: 32 microversion: 2.1 time: 0.593043 Jul 12 18:26:03.576252 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 76/144] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:26:02 2022] POST /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5/action => generated 32 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:26:03.576252 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b70fa50a-1e05-419f-93f5-cc6b77973857 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:03.576252 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b70fa50a-1e05-419f-93f5-cc6b77973857 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:03.576252 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b70fa50a-1e05-419f-93f5-cc6b77973857 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:03.578323 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b70fa50a-1e05-419f-93f5-cc6b77973857 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:03.578323 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b70fa50a-1e05-419f-93f5-cc6b77973857 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:03.578323 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b70fa50a-1e05-419f-93f5-cc6b77973857 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:03.578969 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3c9c23c6-a93b-4e64-827b-10f0f0db38a4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:03.578969 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3c9c23c6-a93b-4e64-827b-10f0f0db38a4 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1503 microversion: 2.1 time: 0.184995 Jul 12 18:26:03.578969 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 69/145] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:03 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:03.768221 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b70fa50a-1e05-419f-93f5-cc6b77973857 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:03.768221 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b70fa50a-1e05-419f-93f5-cc6b77973857 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.205512 Jul 12 18:26:03.768221 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 77/146] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:03 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:04.005141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-abc8b85d-c791-4486-9da7-16d9a926695e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:04.005752 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-abc8b85d-c791-4486-9da7-16d9a926695e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:04.014289 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abc8b85d-c791-4486-9da7-16d9a926695e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:04.015176 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abc8b85d-c791-4486-9da7-16d9a926695e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:04.016140 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abc8b85d-c791-4486-9da7-16d9a926695e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:04.016772 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abc8b85d-c791-4486-9da7-16d9a926695e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:04.216869 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2247a931-f1c5-4981-81e3-f746b2bf28f7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:04.217520 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2247a931-f1c5-4981-81e3-f746b2bf28f7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:04.223895 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2247a931-f1c5-4981-81e3-f746b2bf28f7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:04.224625 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2247a931-f1c5-4981-81e3-f746b2bf28f7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:04.225226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2247a931-f1c5-4981-81e3-f746b2bf28f7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:04.225663 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2247a931-f1c5-4981-81e3-f746b2bf28f7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:04.376053 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-abc8b85d-c791-4486-9da7-16d9a926695e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:04.393355 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-abc8b85d-c791-4486-9da7-16d9a926695e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:04.393355 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-abc8b85d-c791-4486-9da7-16d9a926695e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:04.393355 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-abc8b85d-c791-4486-9da7-16d9a926695e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.391080 Jul 12 18:26:04.393847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 70/147] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:26:03 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:26:04.398312 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2247a931-f1c5-4981-81e3-f746b2bf28f7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:04.408651 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2247a931-f1c5-4981-81e3-f746b2bf28f7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1362 microversion: 2.1 time: 0.195561 Jul 12 18:26:04.418322 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 78/148] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:04 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:26:04.785458 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-971a8f93-256d-42cd-9822-9aa166949038 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:04.786879 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-971a8f93-256d-42cd-9822-9aa166949038 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:04.799469 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-971a8f93-256d-42cd-9822-9aa166949038 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:04.799993 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-971a8f93-256d-42cd-9822-9aa166949038 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:04.800980 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-971a8f93-256d-42cd-9822-9aa166949038 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:04.804857 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-971a8f93-256d-42cd-9822-9aa166949038 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:04.963581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-971a8f93-256d-42cd-9822-9aa166949038 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:04.976378 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-971a8f93-256d-42cd-9822-9aa166949038 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.190412 Jul 12 18:26:04.976378 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 71/149] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:04 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:05.409584 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e613cfe3-2901-455f-aaaa-8b8d2a4b38be tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:05.410206 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e613cfe3-2901-455f-aaaa-8b8d2a4b38be tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:05.417751 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e613cfe3-2901-455f-aaaa-8b8d2a4b38be tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:05.418209 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e613cfe3-2901-455f-aaaa-8b8d2a4b38be tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:05.419006 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e613cfe3-2901-455f-aaaa-8b8d2a4b38be tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:05.419649 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e613cfe3-2901-455f-aaaa-8b8d2a4b38be tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:05.426375 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6203111f-a231-4c59-9484-12c2d3ba33c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:05.427944 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6203111f-a231-4c59-9484-12c2d3ba33c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:05.434665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6203111f-a231-4c59-9484-12c2d3ba33c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:05.435118 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6203111f-a231-4c59-9484-12c2d3ba33c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:05.435894 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6203111f-a231-4c59-9484-12c2d3ba33c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:05.436552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6203111f-a231-4c59-9484-12c2d3ba33c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:05.560137 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e613cfe3-2901-455f-aaaa-8b8d2a4b38be tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:05.570122 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e613cfe3-2901-455f-aaaa-8b8d2a4b38be tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:05.571728 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e613cfe3-2901-455f-aaaa-8b8d2a4b38be tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:05.573716 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e613cfe3-2901-455f-aaaa-8b8d2a4b38be tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.167982 Jul 12 18:26:05.574285 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 79/150] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:26:05 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:26:05.650516 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6203111f-a231-4c59-9484-12c2d3ba33c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:05.653076 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:05.673163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6203111f-a231-4c59-9484-12c2d3ba33c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1547 microversion: 2.1 time: 0.240446 Jul 12 18:26:05.673163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 72/151] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:05 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1547 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:26:05.689247 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e0bb386e-b559-4477-a6d1-bde9be0e4119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:05.690134 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e0bb386e-b559-4477-a6d1-bde9be0e4119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:05.702861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e0bb386e-b559-4477-a6d1-bde9be0e4119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:05.704992 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e0bb386e-b559-4477-a6d1-bde9be0e4119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:05.706746 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e0bb386e-b559-4477-a6d1-bde9be0e4119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:05.708945 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e0bb386e-b559-4477-a6d1-bde9be0e4119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:05.835732 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e0bb386e-b559-4477-a6d1-bde9be0e4119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155334 Jul 12 18:26:05.836695 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 80/152] 10.222.0.47 () {58 vars in 1274 bytes} [Tue Jul 12 18:26:05 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:26:05.921946 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-61630c0b-4621-4c32-8de5-6e5206a7ff1a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64b8a642-f445-48c2-8164-9cc43cd23d4e"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:26:05.923884 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-61630c0b-4621-4c32-8de5-6e5206a7ff1a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:05.937587 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-61630c0b-4621-4c32-8de5-6e5206a7ff1a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:05.938171 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-61630c0b-4621-4c32-8de5-6e5206a7ff1a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:05.939254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-61630c0b-4621-4c32-8de5-6e5206a7ff1a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:05.941608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-61630c0b-4621-4c32-8de5-6e5206a7ff1a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:05.997076 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4578c5d5-9eee-4efa-9da8-88c66a4a1c0a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:05.998798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4578c5d5-9eee-4efa-9da8-88c66a4a1c0a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:06.015373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4578c5d5-9eee-4efa-9da8-88c66a4a1c0a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:06.017929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4578c5d5-9eee-4efa-9da8-88c66a4a1c0a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:06.019993 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4578c5d5-9eee-4efa-9da8-88c66a4a1c0a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:06.021838 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4578c5d5-9eee-4efa-9da8-88c66a4a1c0a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:06.420739 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4578c5d5-9eee-4efa-9da8-88c66a4a1c0a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:06.430362 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4578c5d5-9eee-4efa-9da8-88c66a4a1c0a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.440624 Jul 12 18:26:06.441085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 81/153] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:05 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:06.600029 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4f7c7d33-1974-4628-931e-fa8e5a2ef421 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:06.600953 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4f7c7d33-1974-4628-931e-fa8e5a2ef421 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:06.610797 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f7c7d33-1974-4628-931e-fa8e5a2ef421 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:06.612220 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f7c7d33-1974-4628-931e-fa8e5a2ef421 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:06.613791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f7c7d33-1974-4628-931e-fa8e5a2ef421 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:06.615666 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f7c7d33-1974-4628-931e-fa8e5a2ef421 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:07.075630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4f7c7d33-1974-4628-931e-fa8e5a2ef421 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:07.085697 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4f7c7d33-1974-4628-931e-fa8e5a2ef421 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:07.087524 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4f7c7d33-1974-4628-931e-fa8e5a2ef421 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:07.088927 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4f7c7d33-1974-4628-931e-fa8e5a2ef421 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1407 microversion: 2.20 time: 0.499235 Jul 12 18:26:07.100192 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 82/154] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:26:06 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1407 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:26:07.450031 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cb42d79f-dc41-4844-8ff5-5bff2fcdfe42 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:07.452020 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-cb42d79f-dc41-4844-8ff5-5bff2fcdfe42 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:07.468042 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cb42d79f-dc41-4844-8ff5-5bff2fcdfe42 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:07.469563 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cb42d79f-dc41-4844-8ff5-5bff2fcdfe42 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:07.470490 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cb42d79f-dc41-4844-8ff5-5bff2fcdfe42 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:07.473738 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cb42d79f-dc41-4844-8ff5-5bff2fcdfe42 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:07.763996 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-cb42d79f-dc41-4844-8ff5-5bff2fcdfe42 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:07.773547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-cb42d79f-dc41-4844-8ff5-5bff2fcdfe42 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.327347 Jul 12 18:26:07.774274 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 83/155] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:07 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:07.798788 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-61630c0b-4621-4c32-8de5-6e5206a7ff1a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "POST /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.879633 Jul 12 18:26:07.803275 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 73/156] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:26:05 2022] POST /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57/os-volume_attachments => generated 194 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:26:08.019758 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-36e87333-3fa8-471c-96ee-0650d4388400 req-762c9574-4821-4651-bd0e-df0d076a69fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f6ad973-f294-4c83-bb32-5d90270ada90", "tag": "4cea184a-9c42-4328-b0c5-312d0aa3b4e3"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:26:08.032888 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-36e87333-3fa8-471c-96ee-0650d4388400 req-762c9574-4821-4651-bd0e-df0d076a69fa service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:08.033340 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-36e87333-3fa8-471c-96ee-0650d4388400 req-762c9574-4821-4651-bd0e-df0d076a69fa service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:08.047498 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-36e87333-3fa8-471c-96ee-0650d4388400 req-762c9574-4821-4651-bd0e-df0d076a69fa service nova] Creating event network-changed:4cea184a-9c42-4328-b0c5-312d0aa3b4e3 for instance 5f6ad973-f294-4c83-bb32-5d90270ada90 on hv-cinder-84488 Jul 12 18:26:08.055018 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-36e87333-3fa8-471c-96ee-0650d4388400 req-762c9574-4821-4651-bd0e-df0d076a69fa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046062 Jul 12 18:26:08.056856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 84/157] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:26:08.110063 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-aae497e1-a44e-47c0-a572-bec92f83e7c5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:08.114913 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-aae497e1-a44e-47c0-a572-bec92f83e7c5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:08.120987 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aae497e1-a44e-47c0-a572-bec92f83e7c5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:08.121784 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aae497e1-a44e-47c0-a572-bec92f83e7c5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:08.122824 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aae497e1-a44e-47c0-a572-bec92f83e7c5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:08.123503 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aae497e1-a44e-47c0-a572-bec92f83e7c5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:08.432619 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-aae497e1-a44e-47c0-a572-bec92f83e7c5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:08.447391 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-aae497e1-a44e-47c0-a572-bec92f83e7c5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:08.450952 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-aae497e1-a44e-47c0-a572-bec92f83e7c5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:08.452156 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-aae497e1-a44e-47c0-a572-bec92f83e7c5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1599 microversion: 2.20 time: 0.348872 Jul 12 18:26:08.452795 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 74/158] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:26:08 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1599 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:26:08.482995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-46102d45-7702-413f-aea9-aa3411f4971c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:08.483669 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-46102d45-7702-413f-aea9-aa3411f4971c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:08.495868 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-46102d45-7702-413f-aea9-aa3411f4971c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:08.496969 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-46102d45-7702-413f-aea9-aa3411f4971c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:08.498001 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-46102d45-7702-413f-aea9-aa3411f4971c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:08.498669 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-46102d45-7702-413f-aea9-aa3411f4971c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:08.609599 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-46102d45-7702-413f-aea9-aa3411f4971c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.131674 Jul 12 18:26:08.610315 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 85/159] 10.222.0.47 () {60 vars in 1315 bytes} [Tue Jul 12 18:26:08 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:26:08.793514 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f164c311-cbf9-4f77-9802-4f969f849ad6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:08.794693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f164c311-cbf9-4f77-9802-4f969f849ad6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:08.803260 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f164c311-cbf9-4f77-9802-4f969f849ad6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:08.805341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f164c311-cbf9-4f77-9802-4f969f849ad6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:08.806343 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f164c311-cbf9-4f77-9802-4f969f849ad6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:08.807482 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f164c311-cbf9-4f77-9802-4f969f849ad6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:09.381155 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f164c311-cbf9-4f77-9802-4f969f849ad6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:09.390937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f164c311-cbf9-4f77-9802-4f969f849ad6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.602988 Jul 12 18:26:09.396040 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 75/160] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:08 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:10.388078 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-77dff26f-0eef-455e-9d4d-69993ef0f600 req-fa6c835a-d062-467c-8bf4-6d4374b9b1bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa637fee-4d51-4d79-aed2-ed75805784bf", "tag": "2f9bf653-860b-4ebb-ba76-4f6b0284e567"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:26:10.399007 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-77dff26f-0eef-455e-9d4d-69993ef0f600 req-fa6c835a-d062-467c-8bf4-6d4374b9b1bb service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:10.399448 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-77dff26f-0eef-455e-9d4d-69993ef0f600 req-fa6c835a-d062-467c-8bf4-6d4374b9b1bb service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:10.415036 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2f3f22b1-d0ba-46ae-aea7-9e4f11c562ba tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:10.416382 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2f3f22b1-d0ba-46ae-aea7-9e4f11c562ba tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:10.423185 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-77dff26f-0eef-455e-9d4d-69993ef0f600 req-fa6c835a-d062-467c-8bf4-6d4374b9b1bb service nova] Creating event network-changed:2f9bf653-860b-4ebb-ba76-4f6b0284e567 for instance fa637fee-4d51-4d79-aed2-ed75805784bf on hv-cinder-84488 Jul 12 18:26:10.425068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2f3f22b1-d0ba-46ae-aea7-9e4f11c562ba tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:10.425822 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2f3f22b1-d0ba-46ae-aea7-9e4f11c562ba tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:10.428320 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2f3f22b1-d0ba-46ae-aea7-9e4f11c562ba tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:10.429064 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2f3f22b1-d0ba-46ae-aea7-9e4f11c562ba tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:10.430071 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-77dff26f-0eef-455e-9d4d-69993ef0f600 req-fa6c835a-d062-467c-8bf4-6d4374b9b1bb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048056 Jul 12 18:26:10.431394 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 86/161] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:26:10.847945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2f3f22b1-d0ba-46ae-aea7-9e4f11c562ba tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:10.859044 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2f3f22b1-d0ba-46ae-aea7-9e4f11c562ba tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.449815 Jul 12 18:26:10.859896 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 76/162] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:10 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:11.881683 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-946cc128-cae3-44cc-b91b-3a8fef14d6c9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:11.888505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-946cc128-cae3-44cc-b91b-3a8fef14d6c9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:11.902065 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-946cc128-cae3-44cc-b91b-3a8fef14d6c9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:11.902748 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-946cc128-cae3-44cc-b91b-3a8fef14d6c9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:11.903723 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-946cc128-cae3-44cc-b91b-3a8fef14d6c9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:11.904453 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-946cc128-cae3-44cc-b91b-3a8fef14d6c9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:12.075759 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-946cc128-cae3-44cc-b91b-3a8fef14d6c9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:12.087355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-946cc128-cae3-44cc-b91b-3a8fef14d6c9 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.213116 Jul 12 18:26:12.087898 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 87/163] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:11 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:13.105076 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-919be92b-ce08-4ed6-abf7-dec112a2a7af tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:13.105611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-919be92b-ce08-4ed6-abf7-dec112a2a7af tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:13.112075 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-919be92b-ce08-4ed6-abf7-dec112a2a7af tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:13.112545 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-919be92b-ce08-4ed6-abf7-dec112a2a7af tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:13.113291 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-919be92b-ce08-4ed6-abf7-dec112a2a7af tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:13.113713 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-919be92b-ce08-4ed6-abf7-dec112a2a7af tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:13.247250 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-919be92b-ce08-4ed6-abf7-dec112a2a7af tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:13.255455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-919be92b-ce08-4ed6-abf7-dec112a2a7af tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.154109 Jul 12 18:26:13.256594 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 77/164] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:13 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:14.273519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5b97a720-8127-4e3c-ba96-9826925a7415 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:14.274131 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5b97a720-8127-4e3c-ba96-9826925a7415 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:14.280247 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b97a720-8127-4e3c-ba96-9826925a7415 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:14.280772 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b97a720-8127-4e3c-ba96-9826925a7415 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:14.281514 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b97a720-8127-4e3c-ba96-9826925a7415 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:14.281951 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b97a720-8127-4e3c-ba96-9826925a7415 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:14.432575 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5b97a720-8127-4e3c-ba96-9826925a7415 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:14.441318 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5b97a720-8127-4e3c-ba96-9826925a7415 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.172001 Jul 12 18:26:14.441994 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 88/165] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:14 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:15.472518 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5cd7727a-0227-44c8-9e7e-f84a78062f9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:15.474067 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5cd7727a-0227-44c8-9e7e-f84a78062f9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:15.487170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cd7727a-0227-44c8-9e7e-f84a78062f9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:15.488400 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cd7727a-0227-44c8-9e7e-f84a78062f9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:15.490051 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cd7727a-0227-44c8-9e7e-f84a78062f9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:15.490779 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cd7727a-0227-44c8-9e7e-f84a78062f9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:15.706840 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5cd7727a-0227-44c8-9e7e-f84a78062f9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:15.721416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5cd7727a-0227-44c8-9e7e-f84a78062f9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.261077 Jul 12 18:26:15.722495 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 78/166] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:15 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:16.741265 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-38086a40-013e-49fd-8524-1511b9d65ab3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:16.742123 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-38086a40-013e-49fd-8524-1511b9d65ab3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:16.748504 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-38086a40-013e-49fd-8524-1511b9d65ab3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:16.748961 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-38086a40-013e-49fd-8524-1511b9d65ab3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:16.749735 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-38086a40-013e-49fd-8524-1511b9d65ab3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:16.750345 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-38086a40-013e-49fd-8524-1511b9d65ab3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:16.934395 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-38086a40-013e-49fd-8524-1511b9d65ab3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:16.943817 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-38086a40-013e-49fd-8524-1511b9d65ab3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.206671 Jul 12 18:26:16.944428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 89/167] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:16 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:17.961311 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a1999dbd-e1da-4b7d-a48d-5c0e804b52fc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:17.962070 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a1999dbd-e1da-4b7d-a48d-5c0e804b52fc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:17.968921 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1999dbd-e1da-4b7d-a48d-5c0e804b52fc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:17.969363 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1999dbd-e1da-4b7d-a48d-5c0e804b52fc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:17.970202 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1999dbd-e1da-4b7d-a48d-5c0e804b52fc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:17.970628 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1999dbd-e1da-4b7d-a48d-5c0e804b52fc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:18.103413 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a1999dbd-e1da-4b7d-a48d-5c0e804b52fc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:18.111213 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a1999dbd-e1da-4b7d-a48d-5c0e804b52fc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.154543 Jul 12 18:26:18.111782 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 79/168] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:17 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:19.128860 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ebfd9c21-880c-40e5-ae04-d105cbb0141b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:19.130020 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ebfd9c21-880c-40e5-ae04-d105cbb0141b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:19.136170 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c21-880c-40e5-ae04-d105cbb0141b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:19.136672 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c21-880c-40e5-ae04-d105cbb0141b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:19.137439 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c21-880c-40e5-ae04-d105cbb0141b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:19.137873 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ebfd9c21-880c-40e5-ae04-d105cbb0141b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:19.269348 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ebfd9c21-880c-40e5-ae04-d105cbb0141b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:19.277458 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ebfd9c21-880c-40e5-ae04-d105cbb0141b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.152629 Jul 12 18:26:19.278025 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 90/169] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:19 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:20.294159 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cada6b0f-cf7e-48f7-ae5e-9aec8c028563 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:20.294707 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cada6b0f-cf7e-48f7-ae5e-9aec8c028563 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:20.301851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cada6b0f-cf7e-48f7-ae5e-9aec8c028563 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:20.302506 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cada6b0f-cf7e-48f7-ae5e-9aec8c028563 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:20.303287 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cada6b0f-cf7e-48f7-ae5e-9aec8c028563 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:20.303721 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cada6b0f-cf7e-48f7-ae5e-9aec8c028563 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:20.438271 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cada6b0f-cf7e-48f7-ae5e-9aec8c028563 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:20.446803 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cada6b0f-cf7e-48f7-ae5e-9aec8c028563 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.156396 Jul 12 18:26:20.447382 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 80/170] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:20 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:21.463862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1027befb-6036-4eed-853e-8ee501a73b2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:21.464498 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1027befb-6036-4eed-853e-8ee501a73b2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:21.471190 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1027befb-6036-4eed-853e-8ee501a73b2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:21.471656 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1027befb-6036-4eed-853e-8ee501a73b2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:21.472486 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1027befb-6036-4eed-853e-8ee501a73b2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:21.472928 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1027befb-6036-4eed-853e-8ee501a73b2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:21.613355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1027befb-6036-4eed-853e-8ee501a73b2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:21.619054 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:21.623843 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1027befb-6036-4eed-853e-8ee501a73b2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.163753 Jul 12 18:26:21.624430 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 91/171] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:21 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:22.646424 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0266d98a-8035-47c1-8e81-06fadd3e3147 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:22.647181 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0266d98a-8035-47c1-8e81-06fadd3e3147 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:22.650055 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=84 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:22.655259 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0266d98a-8035-47c1-8e81-06fadd3e3147 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:22.655701 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0266d98a-8035-47c1-8e81-06fadd3e3147 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:22.656511 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0266d98a-8035-47c1-8e81-06fadd3e3147 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:22.656937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0266d98a-8035-47c1-8e81-06fadd3e3147 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:22.814281 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0266d98a-8035-47c1-8e81-06fadd3e3147 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:22.825119 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0266d98a-8035-47c1-8e81-06fadd3e3147 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.183494 Jul 12 18:26:22.833584 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 81/172] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:22 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:23.045491 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7f02a3af-4a5b-4d9e-9e96-c88294173f71 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:23.046087 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7f02a3af-4a5b-4d9e-9e96-c88294173f71 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:23.053676 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7f02a3af-4a5b-4d9e-9e96-c88294173f71 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:23.054195 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7f02a3af-4a5b-4d9e-9e96-c88294173f71 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:23.054990 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7f02a3af-4a5b-4d9e-9e96-c88294173f71 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:23.055434 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7f02a3af-4a5b-4d9e-9e96-c88294173f71 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:23.083889 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7f02a3af-4a5b-4d9e-9e96-c88294173f71 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:26:23.432854 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7f02a3af-4a5b-4d9e-9e96-c88294173f71 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 204 len: 0 microversion: 2.1 time: 0.391009 Jul 12 18:26:23.433566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 92/173] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:26:23 2022] DELETE /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:26:23.443198 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cda10682-a640-4bce-8803-a9aaecae7028 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:23.443807 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cda10682-a640-4bce-8803-a9aaecae7028 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:23.450004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cda10682-a640-4bce-8803-a9aaecae7028 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:23.450459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cda10682-a640-4bce-8803-a9aaecae7028 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:23.451237 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cda10682-a640-4bce-8803-a9aaecae7028 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:23.451669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cda10682-a640-4bce-8803-a9aaecae7028 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:23.601650 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cda10682-a640-4bce-8803-a9aaecae7028 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:23.609974 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cda10682-a640-4bce-8803-a9aaecae7028 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1555 microversion: 2.1 time: 0.172195 Jul 12 18:26:23.610721 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 82/174] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:23 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:23.849705 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fc994bb9-414c-49a9-893a-c4d074fd5bbc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:23.850400 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fc994bb9-414c-49a9-893a-c4d074fd5bbc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:23.857414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fc994bb9-414c-49a9-893a-c4d074fd5bbc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:23.857859 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fc994bb9-414c-49a9-893a-c4d074fd5bbc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:23.858619 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fc994bb9-414c-49a9-893a-c4d074fd5bbc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:23.859049 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fc994bb9-414c-49a9-893a-c4d074fd5bbc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:23.989995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fc994bb9-414c-49a9-893a-c4d074fd5bbc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:24.000696 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fc994bb9-414c-49a9-893a-c4d074fd5bbc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.155266 Jul 12 18:26:24.001266 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 93/175] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:23 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:24.628318 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cf7114fa-64cd-4269-a49d-d6f75f2520c2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:24.628938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cf7114fa-64cd-4269-a49d-d6f75f2520c2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:24.635667 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cf7114fa-64cd-4269-a49d-d6f75f2520c2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:24.636112 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cf7114fa-64cd-4269-a49d-d6f75f2520c2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:24.636911 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cf7114fa-64cd-4269-a49d-d6f75f2520c2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:24.637344 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cf7114fa-64cd-4269-a49d-d6f75f2520c2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:24.769065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cf7114fa-64cd-4269-a49d-d6f75f2520c2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:24.777799 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cf7114fa-64cd-4269-a49d-d6f75f2520c2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1555 microversion: 2.1 time: 0.153308 Jul 12 18:26:24.778342 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 83/176] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:24 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:25.017319 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-eb579482-f3f9-400b-b838-762493f74f4c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:25.017928 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-eb579482-f3f9-400b-b838-762493f74f4c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:25.025067 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-eb579482-f3f9-400b-b838-762493f74f4c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:25.025514 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-eb579482-f3f9-400b-b838-762493f74f4c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:25.026275 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-eb579482-f3f9-400b-b838-762493f74f4c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:25.026708 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-eb579482-f3f9-400b-b838-762493f74f4c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:25.184888 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-eb579482-f3f9-400b-b838-762493f74f4c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:25.193921 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-eb579482-f3f9-400b-b838-762493f74f4c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.180393 Jul 12 18:26:25.194527 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 94/177] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:25 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:25.795400 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8663dc9b-956f-4d33-b404-e6df890fd28d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:25.795898 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8663dc9b-956f-4d33-b404-e6df890fd28d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:25.810947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8663dc9b-956f-4d33-b404-e6df890fd28d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:25.810947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8663dc9b-956f-4d33-b404-e6df890fd28d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:25.810947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8663dc9b-956f-4d33-b404-e6df890fd28d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:25.810947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8663dc9b-956f-4d33-b404-e6df890fd28d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:25.963939 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8663dc9b-956f-4d33-b404-e6df890fd28d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:25.972462 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8663dc9b-956f-4d33-b404-e6df890fd28d tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1555 microversion: 2.1 time: 0.181146 Jul 12 18:26:25.973058 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 84/178] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:25 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1555 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:26.211777 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d9f82edc-76f9-4a1d-8279-c78bfca0e43f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:26.212911 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d9f82edc-76f9-4a1d-8279-c78bfca0e43f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:26.220098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d9f82edc-76f9-4a1d-8279-c78bfca0e43f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:26.220615 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d9f82edc-76f9-4a1d-8279-c78bfca0e43f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:26.225267 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d9f82edc-76f9-4a1d-8279-c78bfca0e43f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:26.225267 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d9f82edc-76f9-4a1d-8279-c78bfca0e43f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:26.382955 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d9f82edc-76f9-4a1d-8279-c78bfca0e43f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:26.391836 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d9f82edc-76f9-4a1d-8279-c78bfca0e43f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.184655 Jul 12 18:26:26.395521 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 95/179] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:26 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:26.990635 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-557e6eeb-8c9f-4776-b09f-c22ed7a35e2c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:26.991189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-557e6eeb-8c9f-4776-b09f-c22ed7a35e2c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:26.997917 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-557e6eeb-8c9f-4776-b09f-c22ed7a35e2c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:26.998362 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-557e6eeb-8c9f-4776-b09f-c22ed7a35e2c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:26.999142 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-557e6eeb-8c9f-4776-b09f-c22ed7a35e2c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:26.999572 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-557e6eeb-8c9f-4776-b09f-c22ed7a35e2c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:27.206224 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-557e6eeb-8c9f-4776-b09f-c22ed7a35e2c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:27.215498 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-557e6eeb-8c9f-4776-b09f-c22ed7a35e2c tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1555 microversion: 2.1 time: 0.229081 Jul 12 18:26:27.216083 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 85/180] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:26 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1555 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:27.350656 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-c08a3791-fab7-4e9e-8137-ee358fcc2631 req-2aa23351-ca00-40cb-9415-132378c88999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2004c12c-256b-47fa-a5bf-9517bcc06b57", "name": "network-vif-deleted", "tag": "43bea616-9f1c-4981-ad8a-ef451790c6d4"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:26:27.360073 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-c08a3791-fab7-4e9e-8137-ee358fcc2631 req-2aa23351-ca00-40cb-9415-132378c88999 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:27.360752 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-c08a3791-fab7-4e9e-8137-ee358fcc2631 req-2aa23351-ca00-40cb-9415-132378c88999 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:27.377808 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-c08a3791-fab7-4e9e-8137-ee358fcc2631 req-2aa23351-ca00-40cb-9415-132378c88999 service nova] Creating event network-vif-deleted:43bea616-9f1c-4981-ad8a-ef451790c6d4 for instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 on hv-cinder-84488 Jul 12 18:26:27.385176 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-c08a3791-fab7-4e9e-8137-ee358fcc2631 req-2aa23351-ca00-40cb-9415-132378c88999 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039999 Jul 12 18:26:27.386083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 96/181] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:26:27.416441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a7399d72-d3bf-4b08-b242-36a4df087344 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:27.417344 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a7399d72-d3bf-4b08-b242-36a4df087344 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:27.425622 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7399d72-d3bf-4b08-b242-36a4df087344 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:27.426072 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7399d72-d3bf-4b08-b242-36a4df087344 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:27.437989 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7399d72-d3bf-4b08-b242-36a4df087344 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:27.438867 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7399d72-d3bf-4b08-b242-36a4df087344 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:27.608376 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a7399d72-d3bf-4b08-b242-36a4df087344 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:27.619941 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a7399d72-d3bf-4b08-b242-36a4df087344 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.213862 Jul 12 18:26:27.620566 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 86/182] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:27 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:26:28.242752 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c6792a0a-c14a-463f-9a16-402a3f3b4d23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:28.242752 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c6792a0a-c14a-463f-9a16-402a3f3b4d23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:28.250545 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6792a0a-c14a-463f-9a16-402a3f3b4d23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:28.251071 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6792a0a-c14a-463f-9a16-402a3f3b4d23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:28.251864 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6792a0a-c14a-463f-9a16-402a3f3b4d23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:28.252339 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6792a0a-c14a-463f-9a16-402a3f3b4d23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:28.332283 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c6792a0a-c14a-463f-9a16-402a3f3b4d23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9f4e1de59734b3f87a982a50b5b2f91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce90d7b4e2540d8a3417db6900d9243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:28.341262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c6792a0a-c14a-463f-9a16-402a3f3b4d23 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 200 len: 1346 microversion: 2.1 time: 0.105002 Jul 12 18:26:28.341852 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 97/183] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:28 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 1346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:28.639192 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-236ece25-241b-4191-920f-088f8a01e3d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:28.640072 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-236ece25-241b-4191-920f-088f8a01e3d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:28.647878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-236ece25-241b-4191-920f-088f8a01e3d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:28.648675 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-236ece25-241b-4191-920f-088f8a01e3d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:28.649535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-236ece25-241b-4191-920f-088f8a01e3d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:28.650182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-236ece25-241b-4191-920f-088f8a01e3d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:28.793499 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-236ece25-241b-4191-920f-088f8a01e3d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:28.803484 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-236ece25-241b-4191-920f-088f8a01e3d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.168338 Jul 12 18:26:28.804143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 87/184] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:28 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:29.363109 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-be069b08-377b-4d44-bdcf-af69d507f5ce tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:29.365122 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-be069b08-377b-4d44-bdcf-af69d507f5ce tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:29.371355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-be069b08-377b-4d44-bdcf-af69d507f5ce tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:29.372050 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-be069b08-377b-4d44-bdcf-af69d507f5ce tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:29.372995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-be069b08-377b-4d44-bdcf-af69d507f5ce tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:29.373422 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-be069b08-377b-4d44-bdcf-af69d507f5ce tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:29.387866 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-be069b08-377b-4d44-bdcf-af69d507f5ce tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] HTTP exception thrown: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-be069b08-377b-4d44-bdcf-af69d507f5ce tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Request method failure captured: Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 HTTP/1.1 Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizbyREm2hG2WHn8V3_EJzDF7Q_Tll2U-OyYvCW9DNRyWBU_743vdKsxdpprneA1sMoif8d7PRazPb5mRPM4sm2UUZV3q6R348GwFTK6aOU7X5itQqBzGTW80G4FCEzBCd4aoviE3wE9k_W7QU7FTKPHA3HWr1cWmgrWGmRp8mKh84AhM Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 5ce90d7b4e2540d8a3417db6900d9243 Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:26:29.392630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5ce90d7b4e2540d8a3417db6900d9243", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 5ce90d7b4e2540d8a3417db6900d9243 Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-DeleteServersTestJSON-311327578-project Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: e9f4e1de59734b3f87a982a50b5b2f91 Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-DeleteServersTestJSON-311327578-project Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:29.400033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': '2004c12c-256b-47fa-a5bf-9517bcc06b57'} Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:26:29.400769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:29.401874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:26:29.402983 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-be069b08-377b-4d44-bdcf-af69d507f5ce tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Returning 404 to user: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:26:29.402983 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-be069b08-377b-4d44-bdcf-af69d507f5ce tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 404 len: 111 microversion: 2.1 time: 0.035231 Jul 12 18:26:29.402983 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 98/185] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:29 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:26:29.521979 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fdd9b821-0583-437c-a12f-52c7f80c52b5 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:29.522958 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fdd9b821-0583-437c-a12f-52c7f80c52b5 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:29.529123 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fdd9b821-0583-437c-a12f-52c7f80c52b5 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:29.529738 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fdd9b821-0583-437c-a12f-52c7f80c52b5 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:29.530786 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fdd9b821-0583-437c-a12f-52c7f80c52b5 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:29.531407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fdd9b821-0583-437c-a12f-52c7f80c52b5 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:29.537175 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:29.547600 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-fdd9b821-0583-437c-a12f-52c7f80c52b5 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] HTTP exception thrown: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fdd9b821-0583-437c-a12f-52c7f80c52b5 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Request method failure captured: Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57/os-volume_attachments HTTP/1.1 Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyREm2hG2WHn8V3_EJzDF7Q_Tll2U-OyYvCW9DNRyWBU_743vdKsxdpprneA1sMoif8d7PRazPb5mRPM4sm2UUZV3q6R348GwFTK6aOU7X5itQqBzGTW80G4FCEzBCd4aoviE3wE9k_W7QU7FTKPHA3HWr1cWmgrWGmRp8mKh84AhM Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 5ce90d7b4e2540d8a3417db6900d9243 Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:26:29.553676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5ce90d7b4e2540d8a3417db6900d9243", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 5ce90d7b4e2540d8a3417db6900d9243 Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-DeleteServersTestJSON-311327578-project Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: e9f4e1de59734b3f87a982a50b5b2f91 Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-DeleteServersTestJSON-311327578-project Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:29.555143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'server_id': '2004c12c-256b-47fa-a5bf-9517bcc06b57'} Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:26:29.555914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:29.557330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:26:29.558655 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fdd9b821-0583-437c-a12f-52c7f80c52b5 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Returning 404 to user: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:26:29.558655 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fdd9b821-0583-437c-a12f-52c7f80c52b5 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037718 Jul 12 18:26:29.559013 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 88/186] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:26:29 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:26:29.821347 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f4ec7dec-ce4b-4606-b42d-25a0ece50c84 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:29.822242 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f4ec7dec-ce4b-4606-b42d-25a0ece50c84 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:29.828949 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f4ec7dec-ce4b-4606-b42d-25a0ece50c84 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:29.829421 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f4ec7dec-ce4b-4606-b42d-25a0ece50c84 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:29.830434 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f4ec7dec-ce4b-4606-b42d-25a0ece50c84 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:29.830884 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f4ec7dec-ce4b-4606-b42d-25a0ece50c84 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:29.988165 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f4ec7dec-ce4b-4606-b42d-25a0ece50c84 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:29.997359 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f4ec7dec-ce4b-4606-b42d-25a0ece50c84 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.180555 Jul 12 18:26:29.997924 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 99/187] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:29 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:31.015428 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f283d27a-924a-424e-906b-8d89f91c0879 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:31.016029 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f283d27a-924a-424e-906b-8d89f91c0879 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:31.024024 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f283d27a-924a-424e-906b-8d89f91c0879 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:31.024517 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f283d27a-924a-424e-906b-8d89f91c0879 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:31.025283 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f283d27a-924a-424e-906b-8d89f91c0879 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:31.025806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f283d27a-924a-424e-906b-8d89f91c0879 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:31.180455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f283d27a-924a-424e-906b-8d89f91c0879 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:31.188493 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f283d27a-924a-424e-906b-8d89f91c0879 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.176853 Jul 12 18:26:31.189427 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 89/188] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:31 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:31.264447 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-dc1b2b00-a625-4d75-93ac-1065a9a27ca2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:31.264937 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-dc1b2b00-a625-4d75-93ac-1065a9a27ca2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:31.271104 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc1b2b00-a625-4d75-93ac-1065a9a27ca2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:31.271545 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc1b2b00-a625-4d75-93ac-1065a9a27ca2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:31.272327 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc1b2b00-a625-4d75-93ac-1065a9a27ca2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:31.272926 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc1b2b00-a625-4d75-93ac-1065a9a27ca2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:31.288513 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-dc1b2b00-a625-4d75-93ac-1065a9a27ca2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] HTTP exception thrown: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-dc1b2b00-a625-4d75-93ac-1065a9a27ca2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Request method failure captured: Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: DELETE /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 HTTP/1.1 Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizbyREm2hG2WHn8V3_EJzDF7Q_Tll2U-OyYvCW9DNRyWBU_743vdKsxdpprneA1sMoif8d7PRazPb5mRPM4sm2UUZV3q6R348GwFTK6aOU7X5itQqBzGTW80G4FCEzBCd4aoviE3wE9k_W7QU7FTKPHA3HWr1cWmgrWGmRp8mKh84AhM Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 5ce90d7b4e2540d8a3417db6900d9243 Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:26:31.291226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5ce90d7b4e2540d8a3417db6900d9243", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 5ce90d7b4e2540d8a3417db6900d9243 Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-DeleteServersTestJSON-311327578-project Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: e9f4e1de59734b3f87a982a50b5b2f91 Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-DeleteServersTestJSON-311327578-project Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:31.302079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': '2004c12c-256b-47fa-a5bf-9517bcc06b57'} Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:26:31.303477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:31.308256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:26:31.310736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-dc1b2b00-a625-4d75-93ac-1065a9a27ca2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Returning 404 to user: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:26:31.310736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-dc1b2b00-a625-4d75-93ac-1065a9a27ca2 tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 404 len: 111 microversion: 2.1 time: 0.031819 Jul 12 18:26:31.310736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 100/189] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:26:31 2022] DELETE /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:26:31.311284 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f6d28e11-ce95-4a40-8c72-fe9245d1129a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:31.311284 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f6d28e11-ce95-4a40-8c72-fe9245d1129a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] [instance: 2004c12c-256b-47fa-a5bf-9517bcc06b57] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:31.311284 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6d28e11-ce95-4a40-8c72-fe9245d1129a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:31.311284 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6d28e11-ce95-4a40-8c72-fe9245d1129a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:31.311833 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6d28e11-ce95-4a40-8c72-fe9245d1129a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:31.311833 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6d28e11-ce95-4a40-8c72-fe9245d1129a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-f6d28e11-ce95-4a40-8c72-fe9245d1129a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] HTTP exception thrown: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f6d28e11-ce95-4a40-8c72-fe9245d1129a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Request method failure captured: Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 HTTP/1.1 Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyREm2hG2WHn8V3_EJzDF7Q_Tll2U-OyYvCW9DNRyWBU_743vdKsxdpprneA1sMoif8d7PRazPb5mRPM4sm2UUZV3q6R348GwFTK6aOU7X5itQqBzGTW80G4FCEzBCd4aoviE3wE9k_W7QU7FTKPHA3HWr1cWmgrWGmRp8mKh84AhM Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 5ce90d7b4e2540d8a3417db6900d9243 Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:26:31.329416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5ce90d7b4e2540d8a3417db6900d9243", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ce90d7b4e2540d8a3417db6900d9243"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 5ce90d7b4e2540d8a3417db6900d9243 Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-DeleteServersTestJSON-311327578 Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-DeleteServersTestJSON-311327578-project Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: e9f4e1de59734b3f87a982a50b5b2f91 Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-DeleteServersTestJSON-311327578-project Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:31.332167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '2004c12c-256b-47fa-a5bf-9517bcc06b57'} Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:26:31.337481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. Jul 12 18:26:31.340810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:26:31.344745 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f6d28e11-ce95-4a40-8c72-fe9245d1129a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] Returning 404 to user: Instance 2004c12c-256b-47fa-a5bf-9517bcc06b57 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:26:31.344745 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f6d28e11-ce95-4a40-8c72-fe9245d1129a tempest-DeleteServersTestJSON-311327578 tempest-DeleteServersTestJSON-311327578-project] 10.222.0.47 "GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57" status: 404 len: 111 microversion: 2.1 time: 0.033281 Jul 12 18:26:31.344745 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 90/190] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:31 2022] GET /compute/v2.1/servers/2004c12c-256b-47fa-a5bf-9517bcc06b57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:26:32.209582 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-894e2a1e-75a4-47b9-9e1c-3fc3f9613630 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:32.213286 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-894e2a1e-75a4-47b9-9e1c-3fc3f9613630 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:32.224984 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-894e2a1e-75a4-47b9-9e1c-3fc3f9613630 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:32.226045 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-894e2a1e-75a4-47b9-9e1c-3fc3f9613630 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:32.227441 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-894e2a1e-75a4-47b9-9e1c-3fc3f9613630 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:32.228276 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-894e2a1e-75a4-47b9-9e1c-3fc3f9613630 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:32.464674 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-894e2a1e-75a4-47b9-9e1c-3fc3f9613630 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:32.483297 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-894e2a1e-75a4-47b9-9e1c-3fc3f9613630 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.277858 Jul 12 18:26:32.484361 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 101/191] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:32 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:33.510840 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6a244bab-f262-4d09-b83d-06005494bec6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:33.513285 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6a244bab-f262-4d09-b83d-06005494bec6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:33.524326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a244bab-f262-4d09-b83d-06005494bec6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:33.525057 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a244bab-f262-4d09-b83d-06005494bec6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:33.526088 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a244bab-f262-4d09-b83d-06005494bec6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:33.526823 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a244bab-f262-4d09-b83d-06005494bec6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:33.778127 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6a244bab-f262-4d09-b83d-06005494bec6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:33.812424 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6a244bab-f262-4d09-b83d-06005494bec6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.308138 Jul 12 18:26:33.817712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 91/192] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:33 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:26:34.857626 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-05f1bbf1-cf2d-42ff-93ce-3b6f49fab176 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:34.857626 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-05f1bbf1-cf2d-42ff-93ce-3b6f49fab176 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:34.858618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05f1bbf1-cf2d-42ff-93ce-3b6f49fab176 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:34.862175 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05f1bbf1-cf2d-42ff-93ce-3b6f49fab176 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:34.863152 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05f1bbf1-cf2d-42ff-93ce-3b6f49fab176 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:34.863747 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05f1bbf1-cf2d-42ff-93ce-3b6f49fab176 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:35.092274 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-05f1bbf1-cf2d-42ff-93ce-3b6f49fab176 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:35.101597 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-05f1bbf1-cf2d-42ff-93ce-3b6f49fab176 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.262403 Jul 12 18:26:35.102363 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 102/193] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:34 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:36.126588 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7c9fe863-2411-4bea-acb1-fa448554d0d6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:36.127618 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7c9fe863-2411-4bea-acb1-fa448554d0d6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:36.145299 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c9fe863-2411-4bea-acb1-fa448554d0d6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:36.146740 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c9fe863-2411-4bea-acb1-fa448554d0d6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:36.148636 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c9fe863-2411-4bea-acb1-fa448554d0d6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:36.151854 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c9fe863-2411-4bea-acb1-fa448554d0d6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:36.421233 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7c9fe863-2411-4bea-acb1-fa448554d0d6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:36.438613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7c9fe863-2411-4bea-acb1-fa448554d0d6 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1522 microversion: 2.1 time: 0.320765 Jul 12 18:26:36.448095 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 92/194] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:36 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:37.461667 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9573958a-df62-4cb6-92ca-f8644194347a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:37.462341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9573958a-df62-4cb6-92ca-f8644194347a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:37.465450 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:37.469012 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9573958a-df62-4cb6-92ca-f8644194347a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:37.469521 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9573958a-df62-4cb6-92ca-f8644194347a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:37.470450 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9573958a-df62-4cb6-92ca-f8644194347a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:37.471017 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9573958a-df62-4cb6-92ca-f8644194347a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:37.858169 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9573958a-df62-4cb6-92ca-f8644194347a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:37.866988 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9573958a-df62-4cb6-92ca-f8644194347a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1502 microversion: 2.1 time: 0.410306 Jul 12 18:26:37.867674 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 103/195] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:37 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:37.885340 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8364b34c-c240-4415-bc00-cb31623bb8f2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:37.885953 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8364b34c-c240-4415-bc00-cb31623bb8f2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:37.892770 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8364b34c-c240-4415-bc00-cb31623bb8f2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:37.896200 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8364b34c-c240-4415-bc00-cb31623bb8f2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:37.896200 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8364b34c-c240-4415-bc00-cb31623bb8f2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:37.896200 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8364b34c-c240-4415-bc00-cb31623bb8f2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:38.037836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8364b34c-c240-4415-bc00-cb31623bb8f2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:38.045671 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8364b34c-c240-4415-bc00-cb31623bb8f2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1515 microversion: 2.1 time: 0.164298 Jul 12 18:26:38.046251 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 93/196] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:37 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:41.858273 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8a0a6f34-7dbc-4aed-9adc-c02667b59977 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:26:41.859605 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8a0a6f34-7dbc-4aed-9adc-c02667b59977 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:41.866853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8a0a6f34-7dbc-4aed-9adc-c02667b59977 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:41.867430 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8a0a6f34-7dbc-4aed-9adc-c02667b59977 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:41.868414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8a0a6f34-7dbc-4aed-9adc-c02667b59977 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:41.868911 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8a0a6f34-7dbc-4aed-9adc-c02667b59977 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:41.895690 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-8a0a6f34-7dbc-4aed-9adc-c02667b59977 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lazy-loading 'flavor' on Instance uuid b08a5b52-4e63-4914-b23c-3818819f7890 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:26:42.250702 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8a0a6f34-7dbc-4aed-9adc-c02667b59977 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "POST /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890/action" status: 200 len: 32 microversion: 2.1 time: 0.391992 Jul 12 18:26:42.250702 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 104/197] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:26:41 2022] POST /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890/action => generated 32 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:26:42.256568 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a5956e3a-c1fb-425a-80be-7946c223812e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:42.256999 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a5956e3a-c1fb-425a-80be-7946c223812e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:42.264272 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a5956e3a-c1fb-425a-80be-7946c223812e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:42.264934 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a5956e3a-c1fb-425a-80be-7946c223812e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:42.266663 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a5956e3a-c1fb-425a-80be-7946c223812e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:42.267671 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a5956e3a-c1fb-425a-80be-7946c223812e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:42.449376 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a5956e3a-c1fb-425a-80be-7946c223812e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:42.458363 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a5956e3a-c1fb-425a-80be-7946c223812e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.205971 Jul 12 18:26:42.458466 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 94/198] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:42 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:43.476942 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bc26b7f5-c5aa-4de8-82d0-b46e013a03c3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:43.477648 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-bc26b7f5-c5aa-4de8-82d0-b46e013a03c3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:43.484869 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc26b7f5-c5aa-4de8-82d0-b46e013a03c3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:43.485570 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc26b7f5-c5aa-4de8-82d0-b46e013a03c3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:43.487572 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc26b7f5-c5aa-4de8-82d0-b46e013a03c3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:43.487572 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc26b7f5-c5aa-4de8-82d0-b46e013a03c3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:43.652139 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-bc26b7f5-c5aa-4de8-82d0-b46e013a03c3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:43.659763 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bc26b7f5-c5aa-4de8-82d0-b46e013a03c3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.188173 Jul 12 18:26:43.660967 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 105/199] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:43 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:44.680673 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-76fc0dd0-a26d-4f67-9436-09bad38f412b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:44.681784 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-76fc0dd0-a26d-4f67-9436-09bad38f412b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:44.691051 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-76fc0dd0-a26d-4f67-9436-09bad38f412b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:44.693030 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-76fc0dd0-a26d-4f67-9436-09bad38f412b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:44.694048 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-76fc0dd0-a26d-4f67-9436-09bad38f412b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:44.698706 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-76fc0dd0-a26d-4f67-9436-09bad38f412b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:44.890919 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-76fc0dd0-a26d-4f67-9436-09bad38f412b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:44.901243 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-76fc0dd0-a26d-4f67-9436-09bad38f412b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.226290 Jul 12 18:26:44.901940 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 95/200] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:44 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:45.930034 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-20bc2790-8d19-40fc-a646-8ba5c4aa9f89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:45.930034 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-20bc2790-8d19-40fc-a646-8ba5c4aa9f89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:45.934519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20bc2790-8d19-40fc-a646-8ba5c4aa9f89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:45.934964 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20bc2790-8d19-40fc-a646-8ba5c4aa9f89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:45.935734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20bc2790-8d19-40fc-a646-8ba5c4aa9f89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:45.936248 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20bc2790-8d19-40fc-a646-8ba5c4aa9f89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:46.131813 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-20bc2790-8d19-40fc-a646-8ba5c4aa9f89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:46.137094 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:46.146200 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-20bc2790-8d19-40fc-a646-8ba5c4aa9f89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.225877 Jul 12 18:26:46.147234 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 106/201] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:45 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:47.175166 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bacdf69a-4116-4885-aa23-a0246b23a97d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:47.176618 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bacdf69a-4116-4885-aa23-a0246b23a97d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:47.186049 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bacdf69a-4116-4885-aa23-a0246b23a97d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:47.186660 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bacdf69a-4116-4885-aa23-a0246b23a97d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:47.187913 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bacdf69a-4116-4885-aa23-a0246b23a97d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:47.188383 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bacdf69a-4116-4885-aa23-a0246b23a97d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:47.355801 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bacdf69a-4116-4885-aa23-a0246b23a97d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:47.363814 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bacdf69a-4116-4885-aa23-a0246b23a97d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.193968 Jul 12 18:26:47.364397 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 96/202] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:47 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:48.381103 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c6dcc44e-02b0-4be4-92fb-53686476b902 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:48.381625 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c6dcc44e-02b0-4be4-92fb-53686476b902 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:48.388672 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6dcc44e-02b0-4be4-92fb-53686476b902 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:48.389138 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6dcc44e-02b0-4be4-92fb-53686476b902 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:48.389931 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6dcc44e-02b0-4be4-92fb-53686476b902 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:48.390375 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6dcc44e-02b0-4be4-92fb-53686476b902 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:48.536643 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c6dcc44e-02b0-4be4-92fb-53686476b902 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:48.544787 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c6dcc44e-02b0-4be4-92fb-53686476b902 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.167577 Jul 12 18:26:48.545392 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 107/203] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:48 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:26:49.568916 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cb7e8bd8-e95c-4847-a842-e0d807fb0c55 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:49.569770 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cb7e8bd8-e95c-4847-a842-e0d807fb0c55 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:49.576607 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb7e8bd8-e95c-4847-a842-e0d807fb0c55 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:49.577130 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb7e8bd8-e95c-4847-a842-e0d807fb0c55 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:49.577908 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb7e8bd8-e95c-4847-a842-e0d807fb0c55 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:49.578335 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb7e8bd8-e95c-4847-a842-e0d807fb0c55 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:49.742460 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cb7e8bd8-e95c-4847-a842-e0d807fb0c55 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:49.750868 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cb7e8bd8-e95c-4847-a842-e0d807fb0c55 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.186147 Jul 12 18:26:49.751464 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 97/204] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:49 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:26:50.772762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7a9750bf-fd7a-441b-bce3-9e77054b9021 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:50.773381 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7a9750bf-fd7a-441b-bce3-9e77054b9021 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:50.779929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a9750bf-fd7a-441b-bce3-9e77054b9021 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:50.780411 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a9750bf-fd7a-441b-bce3-9e77054b9021 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:50.781184 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a9750bf-fd7a-441b-bce3-9e77054b9021 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:50.781621 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a9750bf-fd7a-441b-bce3-9e77054b9021 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:50.952000 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7a9750bf-fd7a-441b-bce3-9e77054b9021 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:50.961530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7a9750bf-fd7a-441b-bce3-9e77054b9021 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.193588 Jul 12 18:26:50.962308 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 108/205] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:50 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:51.987546 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0a498a09-e5f1-47bc-85ad-f1d7bd4da77e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:51.991295 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0a498a09-e5f1-47bc-85ad-f1d7bd4da77e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:52.007006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a498a09-e5f1-47bc-85ad-f1d7bd4da77e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:52.009406 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a498a09-e5f1-47bc-85ad-f1d7bd4da77e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:52.009406 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a498a09-e5f1-47bc-85ad-f1d7bd4da77e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:52.009406 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a498a09-e5f1-47bc-85ad-f1d7bd4da77e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:52.254153 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0a498a09-e5f1-47bc-85ad-f1d7bd4da77e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:52.264564 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0a498a09-e5f1-47bc-85ad-f1d7bd4da77e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.289276 Jul 12 18:26:52.265282 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 98/206] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:51 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:53.287361 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-39ea1456-8587-439e-a40e-832ab98e253f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:53.288602 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-39ea1456-8587-439e-a40e-832ab98e253f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:53.296040 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-39ea1456-8587-439e-a40e-832ab98e253f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:53.296824 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-39ea1456-8587-439e-a40e-832ab98e253f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:53.297877 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-39ea1456-8587-439e-a40e-832ab98e253f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:53.298660 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-39ea1456-8587-439e-a40e-832ab98e253f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:53.530623 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-39ea1456-8587-439e-a40e-832ab98e253f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:53.539657 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-39ea1456-8587-439e-a40e-832ab98e253f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.258174 Jul 12 18:26:53.540361 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 109/207] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:53 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:26:54.558135 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5b2dd617-7759-4ee6-971a-1273745ef856 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:54.560582 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5b2dd617-7759-4ee6-971a-1273745ef856 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:54.562996 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=36 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:54.569793 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5b2dd617-7759-4ee6-971a-1273745ef856 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:54.570494 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5b2dd617-7759-4ee6-971a-1273745ef856 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:54.571415 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5b2dd617-7759-4ee6-971a-1273745ef856 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:54.572147 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5b2dd617-7759-4ee6-971a-1273745ef856 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:54.810595 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5b2dd617-7759-4ee6-971a-1273745ef856 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:54.826871 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5b2dd617-7759-4ee6-971a-1273745ef856 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.272127 Jul 12 18:26:54.828024 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 99/208] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:54 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:55.858596 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4c3c21dc-102e-4b7d-a95e-53f5d8129bb1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:55.859387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4c3c21dc-102e-4b7d-a95e-53f5d8129bb1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:55.866943 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4c3c21dc-102e-4b7d-a95e-53f5d8129bb1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:55.867563 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4c3c21dc-102e-4b7d-a95e-53f5d8129bb1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:55.869687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4c3c21dc-102e-4b7d-a95e-53f5d8129bb1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:55.869687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4c3c21dc-102e-4b7d-a95e-53f5d8129bb1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:56.080911 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4c3c21dc-102e-4b7d-a95e-53f5d8129bb1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:56.089707 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4c3c21dc-102e-4b7d-a95e-53f5d8129bb1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.235716 Jul 12 18:26:56.090883 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 110/209] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:55 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:26:57.109598 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-379df59f-456e-44eb-82bf-9cc00d3e48c1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:57.110365 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-379df59f-456e-44eb-82bf-9cc00d3e48c1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:57.120159 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-379df59f-456e-44eb-82bf-9cc00d3e48c1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:57.120909 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-379df59f-456e-44eb-82bf-9cc00d3e48c1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:57.122097 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-379df59f-456e-44eb-82bf-9cc00d3e48c1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:57.122530 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-379df59f-456e-44eb-82bf-9cc00d3e48c1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:57.410595 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-379df59f-456e-44eb-82bf-9cc00d3e48c1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:57.424532 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-379df59f-456e-44eb-82bf-9cc00d3e48c1 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.319636 Jul 12 18:26:57.425908 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 100/210] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:57 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:58.476647 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a6df3244-5069-42c1-846a-9c3569ae872d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:58.478123 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a6df3244-5069-42c1-846a-9c3569ae872d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:58.485187 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a6df3244-5069-42c1-846a-9c3569ae872d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:58.485632 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a6df3244-5069-42c1-846a-9c3569ae872d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:58.486489 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a6df3244-5069-42c1-846a-9c3569ae872d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:58.486921 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a6df3244-5069-42c1-846a-9c3569ae872d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:58.692596 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a6df3244-5069-42c1-846a-9c3569ae872d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:26:58.701902 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a6df3244-5069-42c1-846a-9c3569ae872d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.246858 Jul 12 18:26:58.703035 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 111/211] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:58 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:26:59.731279 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8e58ae0a-616c-4bf9-8765-3ed24a09e6cf tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:26:59.732700 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8e58ae0a-616c-4bf9-8765-3ed24a09e6cf tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:26:59.749406 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8e58ae0a-616c-4bf9-8765-3ed24a09e6cf tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:59.750141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8e58ae0a-616c-4bf9-8765-3ed24a09e6cf tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:26:59.751677 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8e58ae0a-616c-4bf9-8765-3ed24a09e6cf tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:26:59.752444 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8e58ae0a-616c-4bf9-8765-3ed24a09e6cf tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:00.001852 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8e58ae0a-616c-4bf9-8765-3ed24a09e6cf tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:00.019122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8e58ae0a-616c-4bf9-8765-3ed24a09e6cf tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.301194 Jul 12 18:27:00.032363 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 101/212] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:26:59 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:01.064420 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fb816062-f1db-40b7-9c52-0aae7ccd9117 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:01.065560 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fb816062-f1db-40b7-9c52-0aae7ccd9117 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:01.076577 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fb816062-f1db-40b7-9c52-0aae7ccd9117 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:01.077027 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fb816062-f1db-40b7-9c52-0aae7ccd9117 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:01.078083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fb816062-f1db-40b7-9c52-0aae7ccd9117 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:01.078521 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fb816062-f1db-40b7-9c52-0aae7ccd9117 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:01.281415 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fb816062-f1db-40b7-9c52-0aae7ccd9117 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:01.290315 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fb816062-f1db-40b7-9c52-0aae7ccd9117 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.246352 Jul 12 18:27:01.291059 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 112/213] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:01 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:02.309042 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e783de68-b864-4547-925c-78605051cea0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:02.309864 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e783de68-b864-4547-925c-78605051cea0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:02.317452 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e783de68-b864-4547-925c-78605051cea0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:02.318208 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e783de68-b864-4547-925c-78605051cea0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:02.319010 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e783de68-b864-4547-925c-78605051cea0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:02.319494 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e783de68-b864-4547-925c-78605051cea0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:02.526279 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e783de68-b864-4547-925c-78605051cea0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:02.536606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e783de68-b864-4547-925c-78605051cea0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1501 microversion: 2.1 time: 0.231894 Jul 12 18:27:02.537560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 102/214] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:02 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1501 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:02.554101 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-53df588e-9c5b-454d-9579-ceae4988a841 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac3a991d-cf04-4b80-8b64-85aa2eae36ca"}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:02.555168 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-53df588e-9c5b-454d-9579-ceae4988a841 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:02.561743 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53df588e-9c5b-454d-9579-ceae4988a841 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:02.562186 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53df588e-9c5b-454d-9579-ceae4988a841 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:02.562954 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53df588e-9c5b-454d-9579-ceae4988a841 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:02.563641 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53df588e-9c5b-454d-9579-ceae4988a841 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:02.594078 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-53df588e-9c5b-454d-9579-ceae4988a841 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] HTTP exception thrown: Cannot 'attach_volume' instance b08a5b52-4e63-4914-b23c-3818819f7890 while it is in vm_state rescued Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-53df588e-9c5b-454d-9579-ceae4988a841 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Request method failure captured: Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: POST /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890/os-volume_attachments HTTP/1.1 Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 74 Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizbyL2WKceURQ3_ZkcC34Y0vnD-EGZVufCOFoKfl5xwD31kyWdLgUpvuGYIxbubmz0iOJIC4WFMxdHlep46gbhJgbTsNl3Yq4j2YqV9D8D_aI8PsDZQzyyWWsp3nGlRU1OVMHS9knyY1Zte5rKZdgNY1SWcmoFoIT8GbV17VwJP8_ZwY Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 54167aa5315d4dd2b514ad4b027634f9 Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:27:02.596446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_54167aa5315d4dd2b514ad4b027634f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 54167aa5315d4dd2b514ad4b027634f9 Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-ServerRescueNegativeTestJSON-1109686293-project Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: b58b0d520aa1418bb6ad3b5645a826a7 Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1109686293-project Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {"volumeAttachment": {"volumeId": "ac3a991d-cf04-4b80-8b64-85aa2eae36ca"}} Jul 12 18:27:02.599914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Cannot 'attach_volume' instance b08a5b52-4e63-4914-b23c-3818819f7890 while it is in vm_state rescued Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'server_id': 'b08a5b52-4e63-4914-b23c-3818819f7890', 'body': {'volumeAttachment': {'volumeId': 'ac3a991d-cf04-4b80-8b64-85aa2eae36ca'}}} Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b08a5b52-4e63-4914-b23c-3818819f7890 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:27:02.601460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b08a5b52-4e63-4914-b23c-3818819f7890 while it is in vm_state rescued Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:27:02.603871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:27:02.606519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:27:02.606519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:27:02.606519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b08a5b52-4e63-4914-b23c-3818819f7890 while it is in vm_state rescued Jul 12 18:27:02.606519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:27:02.606519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-53df588e-9c5b-454d-9579-ceae4988a841 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Returning 409 to user: Cannot 'attach_volume' instance b08a5b52-4e63-4914-b23c-3818819f7890 while it is in vm_state rescued {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:27:02.606519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-53df588e-9c5b-454d-9579-ceae4988a841 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "POST /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047642 Jul 12 18:27:02.606519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 113/215] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:27:02 2022] POST /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 18:27:02.608535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0fc6b192-822a-48d9-923f-2a778ab6face tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:02.609092 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0fc6b192-822a-48d9-923f-2a778ab6face tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:02.615918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fc6b192-822a-48d9-923f-2a778ab6face tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:02.616423 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fc6b192-822a-48d9-923f-2a778ab6face tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:02.617243 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fc6b192-822a-48d9-923f-2a778ab6face tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:02.617687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fc6b192-822a-48d9-923f-2a778ab6face tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:02.924096 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0fc6b192-822a-48d9-923f-2a778ab6face tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "POST /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890/action" status: 202 len: 0 microversion: 2.1 time: 0.319257 Jul 12 18:27:02.925068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 103/216] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:27:02 2022] POST /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:27:02.940734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-525e0af1-6152-46a0-b74e-6e31c6a40194 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:02.944030 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-525e0af1-6152-46a0-b74e-6e31c6a40194 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:02.957858 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-525e0af1-6152-46a0-b74e-6e31c6a40194 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:02.958620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-525e0af1-6152-46a0-b74e-6e31c6a40194 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:02.959599 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-525e0af1-6152-46a0-b74e-6e31c6a40194 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:02.960862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-525e0af1-6152-46a0-b74e-6e31c6a40194 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:03.154557 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-525e0af1-6152-46a0-b74e-6e31c6a40194 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:03.170389 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-525e0af1-6152-46a0-b74e-6e31c6a40194 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1509 microversion: 2.1 time: 0.237115 Jul 12 18:27:03.171441 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 114/217] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:02 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1509 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:03.593854 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-675b4c6a-2f0c-4067-8903-a1f5d63a0d3d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:03.595321 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-675b4c6a-2f0c-4067-8903-a1f5d63a0d3d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:03.610191 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-675b4c6a-2f0c-4067-8903-a1f5d63a0d3d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:03.611393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-675b4c6a-2f0c-4067-8903-a1f5d63a0d3d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:03.613611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-675b4c6a-2f0c-4067-8903-a1f5d63a0d3d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:03.614314 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-675b4c6a-2f0c-4067-8903-a1f5d63a0d3d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:03.667717 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:03.680634 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-675b4c6a-2f0c-4067-8903-a1f5d63a0d3d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/ips" status: 200 len: 145 microversion: 2.1 time: 0.097154 Jul 12 18:27:03.682006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 104/218] 10.222.0.47 () {58 vars in 1247 bytes} [Tue Jul 12 18:27:03 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/ips => generated 145 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:27:04.196439 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cf4aba15-4553-4949-bc1e-2882094d1a97 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:04.197095 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-cf4aba15-4553-4949-bc1e-2882094d1a97 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:04.203980 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cf4aba15-4553-4949-bc1e-2882094d1a97 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:04.207790 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cf4aba15-4553-4949-bc1e-2882094d1a97 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:04.207790 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cf4aba15-4553-4949-bc1e-2882094d1a97 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:04.207790 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cf4aba15-4553-4949-bc1e-2882094d1a97 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:04.495525 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-cf4aba15-4553-4949-bc1e-2882094d1a97 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:04.507443 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-cf4aba15-4553-4949-bc1e-2882094d1a97 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1509 microversion: 2.1 time: 0.315958 Jul 12 18:27:04.508681 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 115/219] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:04 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1509 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:05.535720 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1e9b73a5-607b-4a36-a2e5-006b5cb4ef4a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:05.536735 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1e9b73a5-607b-4a36-a2e5-006b5cb4ef4a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:05.547602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e9b73a5-607b-4a36-a2e5-006b5cb4ef4a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:05.548072 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e9b73a5-607b-4a36-a2e5-006b5cb4ef4a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:05.548867 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e9b73a5-607b-4a36-a2e5-006b5cb4ef4a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:05.549500 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e9b73a5-607b-4a36-a2e5-006b5cb4ef4a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:05.757370 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1e9b73a5-607b-4a36-a2e5-006b5cb4ef4a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:05.766515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1e9b73a5-607b-4a36-a2e5-006b5cb4ef4a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1509 microversion: 2.1 time: 0.238790 Jul 12 18:27:05.767254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 105/220] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:05 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:06.437487 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-74d07bd4-f967-4167-9008-4484a54a1ac5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:06.438205 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-74d07bd4-f967-4167-9008-4484a54a1ac5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:06.448455 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-74d07bd4-f967-4167-9008-4484a54a1ac5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:06.449495 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-74d07bd4-f967-4167-9008-4484a54a1ac5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:06.454194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-74d07bd4-f967-4167-9008-4484a54a1ac5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:06.454839 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-74d07bd4-f967-4167-9008-4484a54a1ac5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:06.486576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-74d07bd4-f967-4167-9008-4484a54a1ac5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/ips" status: 200 len: 152 microversion: 2.20 time: 0.054786 Jul 12 18:27:06.487817 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 116/221] 10.222.0.47 () {60 vars in 1288 bytes} [Tue Jul 12 18:27:06 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/ips => generated 152 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:27:06.792412 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-adf0200d-3521-433a-9878-88420c327c62 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:06.793711 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-adf0200d-3521-433a-9878-88420c327c62 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:06.802050 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-adf0200d-3521-433a-9878-88420c327c62 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:06.802531 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-adf0200d-3521-433a-9878-88420c327c62 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:06.803522 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-adf0200d-3521-433a-9878-88420c327c62 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:06.803949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-adf0200d-3521-433a-9878-88420c327c62 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:06.970952 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-adf0200d-3521-433a-9878-88420c327c62 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:06.980757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-adf0200d-3521-433a-9878-88420c327c62 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1509 microversion: 2.1 time: 0.192153 Jul 12 18:27:06.993087 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 106/222] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:06 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:07.999199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7737ad37-d77d-4d2f-891b-17bd6927202a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:07.999804 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7737ad37-d77d-4d2f-891b-17bd6927202a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:08.001808 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=28 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:08.008428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7737ad37-d77d-4d2f-891b-17bd6927202a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:08.008896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7737ad37-d77d-4d2f-891b-17bd6927202a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:08.009674 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7737ad37-d77d-4d2f-891b-17bd6927202a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:08.010117 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7737ad37-d77d-4d2f-891b-17bd6927202a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:08.178783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7737ad37-d77d-4d2f-891b-17bd6927202a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:08.189223 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7737ad37-d77d-4d2f-891b-17bd6927202a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1509 microversion: 2.1 time: 0.193837 Jul 12 18:27:08.198545 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 117/223] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:07 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:09.215970 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ba301856-18f9-41f1-924a-ab3b5c04e87e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:09.218249 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ba301856-18f9-41f1-924a-ab3b5c04e87e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:09.233335 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ba301856-18f9-41f1-924a-ab3b5c04e87e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:09.234950 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ba301856-18f9-41f1-924a-ab3b5c04e87e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:09.236740 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ba301856-18f9-41f1-924a-ab3b5c04e87e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:09.237849 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ba301856-18f9-41f1-924a-ab3b5c04e87e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:09.436832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ba301856-18f9-41f1-924a-ab3b5c04e87e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:09.448915 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ba301856-18f9-41f1-924a-ab3b5c04e87e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1515 microversion: 2.1 time: 0.241099 Jul 12 18:27:09.449694 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 107/224] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:09 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:09.951215 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-204b1ee3-34fd-4776-89ce-626427ccdff4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:09.951927 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-204b1ee3-34fd-4776-89ce-626427ccdff4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:09.959949 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-204b1ee3-34fd-4776-89ce-626427ccdff4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:09.960581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-204b1ee3-34fd-4776-89ce-626427ccdff4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:09.961437 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-204b1ee3-34fd-4776-89ce-626427ccdff4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:09.962144 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-204b1ee3-34fd-4776-89ce-626427ccdff4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:10.011658 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-204b1ee3-34fd-4776-89ce-626427ccdff4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lazy-loading 'flavor' on Instance uuid fa637fee-4d51-4d79-aed2-ed75805784bf {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:27:10.185121 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-71815d2d-3415-4a3f-b954-b1dd5ba9bad3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35f9177d-d493-41bb-9cf7-6c2ce4f8b628"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:10.186267 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-71815d2d-3415-4a3f-b954-b1dd5ba9bad3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:10.193984 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-71815d2d-3415-4a3f-b954-b1dd5ba9bad3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:10.193984 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-71815d2d-3415-4a3f-b954-b1dd5ba9bad3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:10.194613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-71815d2d-3415-4a3f-b954-b1dd5ba9bad3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:10.195087 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-71815d2d-3415-4a3f-b954-b1dd5ba9bad3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:11.255134 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-204b1ee3-34fd-4776-89ce-626427ccdff4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "POST /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/action" status: 202 len: 0 microversion: 2.20 time: 1.308278 Jul 12 18:27:11.262371 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 118/225] 10.222.0.47 () {62 vars in 1318 bytes} [Tue Jul 12 18:27:09 2022] POST /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/action => generated 0 bytes in 1317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:27:11.271660 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b7f5fe38-cb3b-463f-bd55-774d8cc4d966 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:11.272553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b7f5fe38-cb3b-463f-bd55-774d8cc4d966 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:11.281631 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b7f5fe38-cb3b-463f-bd55-774d8cc4d966 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:11.282178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b7f5fe38-cb3b-463f-bd55-774d8cc4d966 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:11.283293 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b7f5fe38-cb3b-463f-bd55-774d8cc4d966 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:11.283774 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b7f5fe38-cb3b-463f-bd55-774d8cc4d966 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:11.695074 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b7f5fe38-cb3b-463f-bd55-774d8cc4d966 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:11.706028 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b7f5fe38-cb3b-463f-bd55-774d8cc4d966 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:11.708293 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b7f5fe38-cb3b-463f-bd55-774d8cc4d966 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:11.709761 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b7f5fe38-cb3b-463f-bd55-774d8cc4d966 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.445292 Jul 12 18:27:11.710667 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 119/226] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:11 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:11.769075 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bd1d46e7-0d37-429e-98e3-d0aa59b82284 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Action: 'create', calling method: .version_select at 0x7f1bb0c06310>, body: {"keypair": {"name": "tempest-keypair-1868441543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODivxIiRWccuiGXPkwiX4VucBX8sssbrpN0dQ2RPytW79QBc4b84HymSJX169Bp0kruCVsqtqYp3g4cGZA/JCqOHvcekYG7IyxlCV+6MqZicNkLIaTWee4C8rcgVMXqcQ=="}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:11.785684 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-bd1d46e7-0d37-429e-98e3-d0aa59b82284 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Getting quotas for project 54167aa5315d4dd2b514ad4b027634f9. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:27:11.791063 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-bd1d46e7-0d37-429e-98e3-d0aa59b82284 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Getting quotas for user b58b0d520aa1418bb6ad3b5645a826a7 and project 54167aa5315d4dd2b514ad4b027634f9. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:27:11.886809 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bd1d46e7-0d37-429e-98e3-d0aa59b82284 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120435 Jul 12 18:27:11.888839 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 120/227] 10.222.0.47 () {60 vars in 1158 bytes} [Tue Jul 12 18:27:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:27:12.101682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-71815d2d-3415-4a3f-b954-b1dd5ba9bad3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "POST /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.921134 Jul 12 18:27:12.102998 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 108/228] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:27:10 2022] POST /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/os-volume_attachments => generated 194 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:27:12.735650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-db776395-325c-431e-9238-5d483b00b3d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:12.737221 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-db776395-325c-431e-9238-5d483b00b3d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:12.752929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db776395-325c-431e-9238-5d483b00b3d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:12.753751 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db776395-325c-431e-9238-5d483b00b3d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:12.756676 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db776395-325c-431e-9238-5d483b00b3d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:12.756676 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db776395-325c-431e-9238-5d483b00b3d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:13.029104 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-db776395-325c-431e-9238-5d483b00b3d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:13.046246 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-db776395-325c-431e-9238-5d483b00b3d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:13.050203 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-db776395-325c-431e-9238-5d483b00b3d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:13.053083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-db776395-325c-431e-9238-5d483b00b3d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.325564 Jul 12 18:27:13.054483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 121/229] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:12 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:14.087549 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-dd9461ef-7b0b-469a-9ea8-e24ffdb67200 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:14.088703 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-dd9461ef-7b0b-469a-9ea8-e24ffdb67200 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:14.098028 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd9461ef-7b0b-469a-9ea8-e24ffdb67200 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:14.098657 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd9461ef-7b0b-469a-9ea8-e24ffdb67200 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:14.099929 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd9461ef-7b0b-469a-9ea8-e24ffdb67200 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:14.100755 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd9461ef-7b0b-469a-9ea8-e24ffdb67200 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:14.622516 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dd9461ef-7b0b-469a-9ea8-e24ffdb67200 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:14.638479 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dd9461ef-7b0b-469a-9ea8-e24ffdb67200 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:14.641663 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dd9461ef-7b0b-469a-9ea8-e24ffdb67200 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:14.643823 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-dd9461ef-7b0b-469a-9ea8-e24ffdb67200 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.562665 Jul 12 18:27:14.645264 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 109/230] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:14 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:27:15.080991 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1192439568", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d3cae64-ca18-412c-87e8-bfda7158b7f8"}], "security_groups": [{"name": "tempest-securitygroup--220847454"}], "key_name": "tempest-keypair-1868441543", "user_data": "}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:15.196964 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] validate_networks() for [('0d3cae64-ca18-412c-87e8-bfda7158b7f8', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:27:15.669806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:27:15.670311 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:27:15.670881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:27:15.671383 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:27:15.671883 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:27:15.675074 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8bcf87b9-66c4-4e0d-94ac-a061c0eafd90 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:15.676931 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8bcf87b9-66c4-4e0d-94ac-a061c0eafd90 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:15.684019 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:15.691400 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:15.691400 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:15.691400 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:15.691963 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8bcf87b9-66c4-4e0d-94ac-a061c0eafd90 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:15.691963 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8bcf87b9-66c4-4e0d-94ac-a061c0eafd90 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:15.691963 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8bcf87b9-66c4-4e0d-94ac-a061c0eafd90 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:15.692608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8bcf87b9-66c4-4e0d-94ac-a061c0eafd90 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:15.711505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Getting quotas for project 54167aa5315d4dd2b514ad4b027634f9. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:27:15.728102 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Getting quotas for user b58b0d520aa1418bb6ad3b5645a826a7 and project 54167aa5315d4dd2b514ad4b027634f9. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:27:15.747972 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:27:15.750911 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:27:15.942476 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8bcf87b9-66c4-4e0d-94ac-a061c0eafd90 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:15.951560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8bcf87b9-66c4-4e0d-94ac-a061c0eafd90 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:15.953195 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8bcf87b9-66c4-4e0d-94ac-a061c0eafd90 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:15.954682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8bcf87b9-66c4-4e0d-94ac-a061c0eafd90 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.286324 Jul 12 18:27:15.955778 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 110/231] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:15 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:27:15.962183 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b43de362-9d51-49e7-bdd7-ac69164ee395 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.885694 Jul 12 18:27:15.962854 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 122/232] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:27:15 2022] POST /compute/v2.1/servers => generated 408 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:27:15.978407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-09a784ce-318b-4e8c-905f-b830870b959b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:15.978407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-09a784ce-318b-4e8c-905f-b830870b959b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:16.077621 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-09a784ce-318b-4e8c-905f-b830870b959b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:16.085987 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-09a784ce-318b-4e8c-905f-b830870b959b tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1246 microversion: 2.1 time: 0.114975 Jul 12 18:27:16.086616 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 111/233] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:15 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:16.983859 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-20c9cf56-6981-432e-8732-2790c39f53a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:16.988522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-20c9cf56-6981-432e-8732-2790c39f53a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:16.992540 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20c9cf56-6981-432e-8732-2790c39f53a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:16.992997 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20c9cf56-6981-432e-8732-2790c39f53a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:16.993805 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20c9cf56-6981-432e-8732-2790c39f53a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:16.994260 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20c9cf56-6981-432e-8732-2790c39f53a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:17.105438 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-89538a87-4116-43ba-a8af-708439c87984 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:17.106273 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-89538a87-4116-43ba-a8af-708439c87984 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:17.115094 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89538a87-4116-43ba-a8af-708439c87984 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:17.115470 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89538a87-4116-43ba-a8af-708439c87984 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:17.116274 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89538a87-4116-43ba-a8af-708439c87984 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:17.116733 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89538a87-4116-43ba-a8af-708439c87984 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:17.196487 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-20c9cf56-6981-432e-8732-2790c39f53a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:17.203702 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:17.217781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-20c9cf56-6981-432e-8732-2790c39f53a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:17.221186 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-20c9cf56-6981-432e-8732-2790c39f53a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:17.223674 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-20c9cf56-6981-432e-8732-2790c39f53a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.244113 Jul 12 18:27:17.224739 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 123/234] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:16 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:27:17.228802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-89538a87-4116-43ba-a8af-708439c87984 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:17.256424 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-89538a87-4116-43ba-a8af-708439c87984 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1250 microversion: 2.1 time: 0.150485 Jul 12 18:27:17.261142 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 112/235] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:17 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1250 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:27:18.253589 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-aed9fe9d-38c1-4ccb-adb0-0c4085f80cdc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:18.255021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-aed9fe9d-38c1-4ccb-adb0-0c4085f80cdc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:18.267575 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aed9fe9d-38c1-4ccb-adb0-0c4085f80cdc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:18.267575 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aed9fe9d-38c1-4ccb-adb0-0c4085f80cdc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:18.267575 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aed9fe9d-38c1-4ccb-adb0-0c4085f80cdc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:18.267575 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aed9fe9d-38c1-4ccb-adb0-0c4085f80cdc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:18.274641 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8aaede70-e6e0-4e7b-b24c-50ac0f1d7980 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:18.276281 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8aaede70-e6e0-4e7b-b24c-50ac0f1d7980 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:18.290398 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8aaede70-e6e0-4e7b-b24c-50ac0f1d7980 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:18.291531 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8aaede70-e6e0-4e7b-b24c-50ac0f1d7980 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:18.296087 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8aaede70-e6e0-4e7b-b24c-50ac0f1d7980 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:18.296087 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8aaede70-e6e0-4e7b-b24c-50ac0f1d7980 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:18.401359 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8aaede70-e6e0-4e7b-b24c-50ac0f1d7980 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:18.419957 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8aaede70-e6e0-4e7b-b24c-50ac0f1d7980 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1298 microversion: 2.1 time: 0.151730 Jul 12 18:27:18.422056 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 113/236] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:18 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:18.484628 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-aed9fe9d-38c1-4ccb-adb0-0c4085f80cdc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:18.497973 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-aed9fe9d-38c1-4ccb-adb0-0c4085f80cdc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:18.500220 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-aed9fe9d-38c1-4ccb-adb0-0c4085f80cdc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:18.502032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-aed9fe9d-38c1-4ccb-adb0-0c4085f80cdc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.252937 Jul 12 18:27:18.502755 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 124/237] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:18 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:19.454552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e177e9cf-1dd4-4087-bf99-17acf8d0c8df tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:19.460374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e177e9cf-1dd4-4087-bf99-17acf8d0c8df tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:19.472711 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e177e9cf-1dd4-4087-bf99-17acf8d0c8df tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:19.473494 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e177e9cf-1dd4-4087-bf99-17acf8d0c8df tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:19.474887 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e177e9cf-1dd4-4087-bf99-17acf8d0c8df tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:19.475640 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e177e9cf-1dd4-4087-bf99-17acf8d0c8df tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:19.525505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-30279e9d-4799-463a-935f-6285522db872 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:19.526245 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-30279e9d-4799-463a-935f-6285522db872 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:19.532573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30279e9d-4799-463a-935f-6285522db872 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:19.533118 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30279e9d-4799-463a-935f-6285522db872 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:19.533982 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30279e9d-4799-463a-935f-6285522db872 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:19.534626 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30279e9d-4799-463a-935f-6285522db872 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:19.565978 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e177e9cf-1dd4-4087-bf99-17acf8d0c8df tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:19.574483 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e177e9cf-1dd4-4087-bf99-17acf8d0c8df tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1304 microversion: 2.1 time: 0.127666 Jul 12 18:27:19.575560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 114/238] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:19 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:19.758429 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-30279e9d-4799-463a-935f-6285522db872 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:19.767648 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-30279e9d-4799-463a-935f-6285522db872 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:19.769683 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-30279e9d-4799-463a-935f-6285522db872 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:19.771727 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-30279e9d-4799-463a-935f-6285522db872 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.250133 Jul 12 18:27:19.772427 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 125/239] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:19 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:27:20.592695 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8d13ddf3-00e5-41a4-a482-4a10a3c600c5 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:20.593542 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8d13ddf3-00e5-41a4-a482-4a10a3c600c5 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:20.604045 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d13ddf3-00e5-41a4-a482-4a10a3c600c5 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:20.604697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d13ddf3-00e5-41a4-a482-4a10a3c600c5 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:20.605653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d13ddf3-00e5-41a4-a482-4a10a3c600c5 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:20.606145 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d13ddf3-00e5-41a4-a482-4a10a3c600c5 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:20.698412 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8d13ddf3-00e5-41a4-a482-4a10a3c600c5 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:20.710318 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8d13ddf3-00e5-41a4-a482-4a10a3c600c5 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1304 microversion: 2.1 time: 0.121465 Jul 12 18:27:20.711243 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 115/240] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:20 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:20.793177 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fa814879-ec92-4396-aa4b-adab01b2211a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:20.793797 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fa814879-ec92-4396-aa4b-adab01b2211a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:20.800461 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fa814879-ec92-4396-aa4b-adab01b2211a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:20.801984 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fa814879-ec92-4396-aa4b-adab01b2211a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:20.802806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fa814879-ec92-4396-aa4b-adab01b2211a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:20.803254 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fa814879-ec92-4396-aa4b-adab01b2211a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:20.965914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fa814879-ec92-4396-aa4b-adab01b2211a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:20.985164 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fa814879-ec92-4396-aa4b-adab01b2211a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:20.989221 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fa814879-ec92-4396-aa4b-adab01b2211a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:20.993216 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fa814879-ec92-4396-aa4b-adab01b2211a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.202916 Jul 12 18:27:20.993216 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 126/241] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:20 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:27:21.740831 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-87d39312-c673-4803-b357-445d2330ca11 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:21.741700 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-87d39312-c673-4803-b357-445d2330ca11 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:21.749608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-87d39312-c673-4803-b357-445d2330ca11 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:21.750147 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-87d39312-c673-4803-b357-445d2330ca11 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:21.751142 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-87d39312-c673-4803-b357-445d2330ca11 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:21.751661 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-87d39312-c673-4803-b357-445d2330ca11 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:21.832868 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-87d39312-c673-4803-b357-445d2330ca11 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:21.840836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-87d39312-c673-4803-b357-445d2330ca11 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1304 microversion: 2.1 time: 0.105142 Jul 12 18:27:21.841432 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 116/242] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:21 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:22.025903 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9215e84d-4e1d-49c7-a6cd-4bcf75789f1c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:22.027324 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9215e84d-4e1d-49c7-a6cd-4bcf75789f1c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:22.033793 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9215e84d-4e1d-49c7-a6cd-4bcf75789f1c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:22.034456 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9215e84d-4e1d-49c7-a6cd-4bcf75789f1c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:22.035885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9215e84d-4e1d-49c7-a6cd-4bcf75789f1c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:22.036412 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9215e84d-4e1d-49c7-a6cd-4bcf75789f1c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:22.263018 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9215e84d-4e1d-49c7-a6cd-4bcf75789f1c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:22.280644 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9215e84d-4e1d-49c7-a6cd-4bcf75789f1c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:22.286056 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9215e84d-4e1d-49c7-a6cd-4bcf75789f1c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:22.287490 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9215e84d-4e1d-49c7-a6cd-4bcf75789f1c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.265663 Jul 12 18:27:22.292803 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 127/243] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:22 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:27:22.866556 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5aae1375-f909-4830-ba5b-90bb863e1440 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:22.867750 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5aae1375-f909-4830-ba5b-90bb863e1440 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:22.879272 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5aae1375-f909-4830-ba5b-90bb863e1440 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:22.879643 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5aae1375-f909-4830-ba5b-90bb863e1440 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:22.880748 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5aae1375-f909-4830-ba5b-90bb863e1440 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:22.881616 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5aae1375-f909-4830-ba5b-90bb863e1440 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:23.246680 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5aae1375-f909-4830-ba5b-90bb863e1440 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:23.282875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5aae1375-f909-4830-ba5b-90bb863e1440 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.426675 Jul 12 18:27:23.284994 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 117/244] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:22 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:27:23.316885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-230fa578-3a1e-4158-9597-e794287fae43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:23.318848 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-230fa578-3a1e-4158-9597-e794287fae43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:23.326659 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-230fa578-3a1e-4158-9597-e794287fae43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:23.327739 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-230fa578-3a1e-4158-9597-e794287fae43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:23.328968 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-230fa578-3a1e-4158-9597-e794287fae43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:23.331384 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-230fa578-3a1e-4158-9597-e794287fae43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:23.618515 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-230fa578-3a1e-4158-9597-e794287fae43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:23.630191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-230fa578-3a1e-4158-9597-e794287fae43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:23.632294 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-230fa578-3a1e-4158-9597-e794287fae43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:23.638287 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-230fa578-3a1e-4158-9597-e794287fae43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.322484 Jul 12 18:27:23.638287 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 128/245] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:23 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:24.315677 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-83dd9a25-c5e5-4027-8a8c-558a1c697598 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:24.315677 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-83dd9a25-c5e5-4027-8a8c-558a1c697598 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:24.344643 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-83dd9a25-c5e5-4027-8a8c-558a1c697598 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:24.346586 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-83dd9a25-c5e5-4027-8a8c-558a1c697598 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:24.351925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-83dd9a25-c5e5-4027-8a8c-558a1c697598 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:24.351925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-83dd9a25-c5e5-4027-8a8c-558a1c697598 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:24.549687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-61e8f8e9-f1a7-453d-81d3-a06953e5683e req-a7330817-12fc-4018-bce2-fb5ca7596923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7062eaf-78a1-4879-9edb-6465141472bc", "tag": "481a00ce-3877-4a82-887d-6774ec1254f9"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:24.559758 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-61e8f8e9-f1a7-453d-81d3-a06953e5683e req-a7330817-12fc-4018-bce2-fb5ca7596923 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:24.560445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-61e8f8e9-f1a7-453d-81d3-a06953e5683e req-a7330817-12fc-4018-bce2-fb5ca7596923 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:24.583137 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-61e8f8e9-f1a7-453d-81d3-a06953e5683e req-a7330817-12fc-4018-bce2-fb5ca7596923 service nova] Creating event network-changed:481a00ce-3877-4a82-887d-6774ec1254f9 for instance f7062eaf-78a1-4879-9edb-6465141472bc on hv-cinder-84488 Jul 12 18:27:24.593865 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-61e8f8e9-f1a7-453d-81d3-a06953e5683e req-a7330817-12fc-4018-bce2-fb5ca7596923 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048050 Jul 12 18:27:24.594827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 129/246] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:27:24.666181 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-53e076b5-38c0-42ea-899d-da1bdce719ef tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:24.667166 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-53e076b5-38c0-42ea-899d-da1bdce719ef tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:24.674030 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53e076b5-38c0-42ea-899d-da1bdce719ef tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:24.674460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53e076b5-38c0-42ea-899d-da1bdce719ef tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:24.675892 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53e076b5-38c0-42ea-899d-da1bdce719ef tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:24.676480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53e076b5-38c0-42ea-899d-da1bdce719ef tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:24.861429 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-83dd9a25-c5e5-4027-8a8c-558a1c697598 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:24.879699 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-83dd9a25-c5e5-4027-8a8c-558a1c697598 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.570808 Jul 12 18:27:24.889767 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 118/247] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:24 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:24.895978 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-29462cf7-13bb-4ebe-af08-24294276d4d7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:24.901589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=42 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:24.903885 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-29462cf7-13bb-4ebe-af08-24294276d4d7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:24.904350 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-29462cf7-13bb-4ebe-af08-24294276d4d7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:24.933373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-53e076b5-38c0-42ea-899d-da1bdce719ef tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:24.960496 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-53e076b5-38c0-42ea-899d-da1bdce719ef tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:24.963882 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-53e076b5-38c0-42ea-899d-da1bdce719ef tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:24.966374 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-53e076b5-38c0-42ea-899d-da1bdce719ef tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.304680 Jul 12 18:27:24.980009 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 130/248] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:24 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:25.001951 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-29462cf7-13bb-4ebe-af08-24294276d4d7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Going to try to stop instance {{(pid=118410) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 18:27:25.169630 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:25.251047 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-29462cf7-13bb-4ebe-af08-24294276d4d7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "POST /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/action" status: 202 len: 0 microversion: 2.1 time: 0.358828 Jul 12 18:27:25.257602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 119/249] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:27:24 2022] POST /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:27:25.267618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2cf0eb8b-93a8-44ff-81bb-92db0b492d6c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:25.268923 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2cf0eb8b-93a8-44ff-81bb-92db0b492d6c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:25.298241 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2cf0eb8b-93a8-44ff-81bb-92db0b492d6c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:25.300905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2cf0eb8b-93a8-44ff-81bb-92db0b492d6c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:25.302421 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2cf0eb8b-93a8-44ff-81bb-92db0b492d6c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:25.306034 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2cf0eb8b-93a8-44ff-81bb-92db0b492d6c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:25.647822 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2cf0eb8b-93a8-44ff-81bb-92db0b492d6c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:25.662017 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2cf0eb8b-93a8-44ff-81bb-92db0b492d6c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.401499 Jul 12 18:27:25.663177 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 131/250] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:25 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:25.907086 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-68f84cfa-0e62-4660-9056-cc4d65355c9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:25.908733 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-68f84cfa-0e62-4660-9056-cc4d65355c9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:25.921032 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-68f84cfa-0e62-4660-9056-cc4d65355c9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:25.922315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-68f84cfa-0e62-4660-9056-cc4d65355c9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:25.923604 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-68f84cfa-0e62-4660-9056-cc4d65355c9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:25.924578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-68f84cfa-0e62-4660-9056-cc4d65355c9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:26.015389 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-eda7c437-f9b1-42ca-ae8a-96696f042d6a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:26.016849 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-eda7c437-f9b1-42ca-ae8a-96696f042d6a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:26.022911 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:26.023995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=10 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:26.031760 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-eda7c437-f9b1-42ca-ae8a-96696f042d6a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:26.032494 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-eda7c437-f9b1-42ca-ae8a-96696f042d6a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:26.033777 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-eda7c437-f9b1-42ca-ae8a-96696f042d6a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:26.036825 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-eda7c437-f9b1-42ca-ae8a-96696f042d6a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:26.086708 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:26.275713 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-68f84cfa-0e62-4660-9056-cc4d65355c9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:26.300292 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-68f84cfa-0e62-4660-9056-cc4d65355c9c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.402508 Jul 12 18:27:26.305049 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 120/251] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:25 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:26.425000 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-eda7c437-f9b1-42ca-ae8a-96696f042d6a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:26.436252 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-eda7c437-f9b1-42ca-ae8a-96696f042d6a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:26.438159 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-eda7c437-f9b1-42ca-ae8a-96696f042d6a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:26.439638 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-eda7c437-f9b1-42ca-ae8a-96696f042d6a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.435720 Jul 12 18:27:26.440505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 132/252] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:26 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:26.685958 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0331b25f-4214-42a5-a349-375a6e83a119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:26.686738 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0331b25f-4214-42a5-a349-375a6e83a119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:26.697346 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0331b25f-4214-42a5-a349-375a6e83a119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:26.698118 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0331b25f-4214-42a5-a349-375a6e83a119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:26.699194 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0331b25f-4214-42a5-a349-375a6e83a119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:26.699776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0331b25f-4214-42a5-a349-375a6e83a119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:26.932298 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0331b25f-4214-42a5-a349-375a6e83a119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:26.944893 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0331b25f-4214-42a5-a349-375a6e83a119 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.267166 Jul 12 18:27:26.945969 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 121/253] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:26 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:27:27.328939 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8b21f074-30cc-4019-b4f7-e33a5cc72802 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:27.329997 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8b21f074-30cc-4019-b4f7-e33a5cc72802 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:27.340931 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8b21f074-30cc-4019-b4f7-e33a5cc72802 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:27.341458 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8b21f074-30cc-4019-b4f7-e33a5cc72802 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:27.342401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8b21f074-30cc-4019-b4f7-e33a5cc72802 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:27.343000 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8b21f074-30cc-4019-b4f7-e33a5cc72802 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:27.468704 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-29dc3b17-cde1-43b0-99d5-59ef59a0be34 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:27.469880 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-29dc3b17-cde1-43b0-99d5-59ef59a0be34 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:27.482180 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-29dc3b17-cde1-43b0-99d5-59ef59a0be34 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:27.482792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-29dc3b17-cde1-43b0-99d5-59ef59a0be34 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:27.483799 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-29dc3b17-cde1-43b0-99d5-59ef59a0be34 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:27.484491 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-29dc3b17-cde1-43b0-99d5-59ef59a0be34 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:27.563996 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8b21f074-30cc-4019-b4f7-e33a5cc72802 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:27.574072 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8b21f074-30cc-4019-b4f7-e33a5cc72802 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.251799 Jul 12 18:27:27.575094 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 133/254] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:27 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:27.698838 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-29dc3b17-cde1-43b0-99d5-59ef59a0be34 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:27.718502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-29dc3b17-cde1-43b0-99d5-59ef59a0be34 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:27.718929 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-29dc3b17-cde1-43b0-99d5-59ef59a0be34 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:27.721198 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-29dc3b17-cde1-43b0-99d5-59ef59a0be34 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.258531 Jul 12 18:27:27.722232 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 122/255] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:27 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:27.968976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d612c462-67a3-4c5f-9c4d-755a59990e36 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:27.969550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d612c462-67a3-4c5f-9c4d-755a59990e36 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:27.977187 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d612c462-67a3-4c5f-9c4d-755a59990e36 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:27.977653 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d612c462-67a3-4c5f-9c4d-755a59990e36 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:27.978489 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d612c462-67a3-4c5f-9c4d-755a59990e36 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:27.978926 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d612c462-67a3-4c5f-9c4d-755a59990e36 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:28.171963 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d612c462-67a3-4c5f-9c4d-755a59990e36 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:28.181557 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d612c462-67a3-4c5f-9c4d-755a59990e36 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.217130 Jul 12 18:27:28.182187 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 134/256] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:27 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:28.607715 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-284fd965-b942-4b53-ac31-1dfafcacee83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:28.608352 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-284fd965-b942-4b53-ac31-1dfafcacee83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:28.617893 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-284fd965-b942-4b53-ac31-1dfafcacee83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:28.618352 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-284fd965-b942-4b53-ac31-1dfafcacee83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:28.619144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-284fd965-b942-4b53-ac31-1dfafcacee83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:28.619583 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-284fd965-b942-4b53-ac31-1dfafcacee83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:28.742765 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7cf72b2b-4dcc-47bb-bc39-acaaaf5dd789 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:28.743677 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7cf72b2b-4dcc-47bb-bc39-acaaaf5dd789 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:28.750638 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7cf72b2b-4dcc-47bb-bc39-acaaaf5dd789 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:28.751123 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7cf72b2b-4dcc-47bb-bc39-acaaaf5dd789 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:28.752033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7cf72b2b-4dcc-47bb-bc39-acaaaf5dd789 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:28.752523 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7cf72b2b-4dcc-47bb-bc39-acaaaf5dd789 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:28.822019 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-284fd965-b942-4b53-ac31-1dfafcacee83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:28.836256 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-284fd965-b942-4b53-ac31-1dfafcacee83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.232551 Jul 12 18:27:28.837229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 123/257] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:28 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:28.928631 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7cf72b2b-4dcc-47bb-bc39-acaaaf5dd789 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:28.937706 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7cf72b2b-4dcc-47bb-bc39-acaaaf5dd789 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:28.940112 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7cf72b2b-4dcc-47bb-bc39-acaaaf5dd789 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:28.942341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7cf72b2b-4dcc-47bb-bc39-acaaaf5dd789 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.203466 Jul 12 18:27:28.946134 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 135/258] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:28 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:27:29.216932 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6875a21b-9268-430b-8715-2cbfcdd6c51f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:29.218204 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6875a21b-9268-430b-8715-2cbfcdd6c51f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:29.233345 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6875a21b-9268-430b-8715-2cbfcdd6c51f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:29.233669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6875a21b-9268-430b-8715-2cbfcdd6c51f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:29.239373 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6875a21b-9268-430b-8715-2cbfcdd6c51f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:29.240171 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6875a21b-9268-430b-8715-2cbfcdd6c51f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:29.453924 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6875a21b-9268-430b-8715-2cbfcdd6c51f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:29.467842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6875a21b-9268-430b-8715-2cbfcdd6c51f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.269379 Jul 12 18:27:29.468629 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 124/259] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:29 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:29.855162 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ba2dd3ee-b456-496f-a107-be2b695b96ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:29.856296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ba2dd3ee-b456-496f-a107-be2b695b96ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:29.862974 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba2dd3ee-b456-496f-a107-be2b695b96ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:29.863537 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba2dd3ee-b456-496f-a107-be2b695b96ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:29.864541 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba2dd3ee-b456-496f-a107-be2b695b96ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:29.865158 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba2dd3ee-b456-496f-a107-be2b695b96ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:29.962521 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0c17199e-43e5-4ef9-9b21-36fc5e8ab614 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:29.963127 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0c17199e-43e5-4ef9-9b21-36fc5e8ab614 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:29.971153 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c17199e-43e5-4ef9-9b21-36fc5e8ab614 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:29.972100 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c17199e-43e5-4ef9-9b21-36fc5e8ab614 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:29.973374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c17199e-43e5-4ef9-9b21-36fc5e8ab614 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:29.973836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c17199e-43e5-4ef9-9b21-36fc5e8ab614 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:30.070510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ba2dd3ee-b456-496f-a107-be2b695b96ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:30.085791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ba2dd3ee-b456-496f-a107-be2b695b96ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.235132 Jul 12 18:27:30.087630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 136/260] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:29 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:30.300038 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0c17199e-43e5-4ef9-9b21-36fc5e8ab614 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:30.326680 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0c17199e-43e5-4ef9-9b21-36fc5e8ab614 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:30.330002 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0c17199e-43e5-4ef9-9b21-36fc5e8ab614 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:30.333062 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0c17199e-43e5-4ef9-9b21-36fc5e8ab614 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.373750 Jul 12 18:27:30.334489 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 125/261] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:29 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:27:30.495057 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1ac4a7fd-eca3-4014-86c3-9baf84f2aff6 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:30.496165 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1ac4a7fd-eca3-4014-86c3-9baf84f2aff6 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:30.515176 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1ac4a7fd-eca3-4014-86c3-9baf84f2aff6 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:30.515176 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1ac4a7fd-eca3-4014-86c3-9baf84f2aff6 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:30.515176 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1ac4a7fd-eca3-4014-86c3-9baf84f2aff6 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:30.515176 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1ac4a7fd-eca3-4014-86c3-9baf84f2aff6 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:30.847018 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1ac4a7fd-eca3-4014-86c3-9baf84f2aff6 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:30.878596 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1ac4a7fd-eca3-4014-86c3-9baf84f2aff6 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.388968 Jul 12 18:27:30.881938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 137/262] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:30 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:31.141094 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9acfd941-0431-42f9-8a15-406750ec0352 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:31.143325 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9acfd941-0431-42f9-8a15-406750ec0352 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:31.162829 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9acfd941-0431-42f9-8a15-406750ec0352 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:31.163497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9acfd941-0431-42f9-8a15-406750ec0352 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:31.165028 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9acfd941-0431-42f9-8a15-406750ec0352 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:31.165616 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9acfd941-0431-42f9-8a15-406750ec0352 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:31.352994 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e2c1ef9b-d74f-4833-b134-cc3783d9dc68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:31.353846 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e2c1ef9b-d74f-4833-b134-cc3783d9dc68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:31.363323 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e2c1ef9b-d74f-4833-b134-cc3783d9dc68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:31.364270 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e2c1ef9b-d74f-4833-b134-cc3783d9dc68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:31.365601 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e2c1ef9b-d74f-4833-b134-cc3783d9dc68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:31.366288 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e2c1ef9b-d74f-4833-b134-cc3783d9dc68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:31.547485 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e2c1ef9b-d74f-4833-b134-cc3783d9dc68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:31.563655 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e2c1ef9b-d74f-4833-b134-cc3783d9dc68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:31.567085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e2c1ef9b-d74f-4833-b134-cc3783d9dc68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:31.569389 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e2c1ef9b-d74f-4833-b134-cc3783d9dc68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.219871 Jul 12 18:27:31.569389 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 138/263] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:31 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:31.682922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9acfd941-0431-42f9-8a15-406750ec0352 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:31.698320 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9acfd941-0431-42f9-8a15-406750ec0352 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.582445 Jul 12 18:27:31.699585 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 126/264] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:31 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:31.911398 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-152a6765-b7ff-4600-b879-1688ccfee063 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:31.912827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-152a6765-b7ff-4600-b879-1688ccfee063 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:31.920064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-152a6765-b7ff-4600-b879-1688ccfee063 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:31.920570 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-152a6765-b7ff-4600-b879-1688ccfee063 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:31.921511 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-152a6765-b7ff-4600-b879-1688ccfee063 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:31.921948 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-152a6765-b7ff-4600-b879-1688ccfee063 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:32.140003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-152a6765-b7ff-4600-b879-1688ccfee063 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:32.156170 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-152a6765-b7ff-4600-b879-1688ccfee063 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.251999 Jul 12 18:27:32.157769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 139/265] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:31 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:32.588373 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c710ba50-adcc-4c6f-a932-85419cfbb029 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:32.589238 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c710ba50-adcc-4c6f-a932-85419cfbb029 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:32.596825 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c710ba50-adcc-4c6f-a932-85419cfbb029 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:32.597268 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c710ba50-adcc-4c6f-a932-85419cfbb029 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:32.599693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c710ba50-adcc-4c6f-a932-85419cfbb029 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:32.600419 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c710ba50-adcc-4c6f-a932-85419cfbb029 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:32.726868 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a43a9ad4-a825-4c9a-b290-bffff15acce2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:32.727503 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a43a9ad4-a825-4c9a-b290-bffff15acce2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:32.741653 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a43a9ad4-a825-4c9a-b290-bffff15acce2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:32.744011 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a43a9ad4-a825-4c9a-b290-bffff15acce2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:32.747805 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a43a9ad4-a825-4c9a-b290-bffff15acce2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:32.749038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a43a9ad4-a825-4c9a-b290-bffff15acce2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:32.984790 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a43a9ad4-a825-4c9a-b290-bffff15acce2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:33.007177 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a43a9ad4-a825-4c9a-b290-bffff15acce2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.285522 Jul 12 18:27:33.008352 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 140/266] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:32 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:27:33.186068 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e3bcd4ff-1b4e-48a7-98ac-97288eb08cb2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:33.186893 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e3bcd4ff-1b4e-48a7-98ac-97288eb08cb2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:33.215046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c710ba50-adcc-4c6f-a932-85419cfbb029 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:33.215336 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e3bcd4ff-1b4e-48a7-98ac-97288eb08cb2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:33.215336 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e3bcd4ff-1b4e-48a7-98ac-97288eb08cb2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:33.215717 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e3bcd4ff-1b4e-48a7-98ac-97288eb08cb2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:33.215886 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e3bcd4ff-1b4e-48a7-98ac-97288eb08cb2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:33.219262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c710ba50-adcc-4c6f-a932-85419cfbb029 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:33.222408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=100 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:33.225401 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c710ba50-adcc-4c6f-a932-85419cfbb029 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:33.226607 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c710ba50-adcc-4c6f-a932-85419cfbb029 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.642897 Jul 12 18:27:33.233868 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 127/267] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:32 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:27:33.603753 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e3bcd4ff-1b4e-48a7-98ac-97288eb08cb2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:33.625024 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e3bcd4ff-1b4e-48a7-98ac-97288eb08cb2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.445494 Jul 12 18:27:33.626297 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 141/268] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:33 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:27:34.039000 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-65b94c26-a392-44ad-b177-1481f32002a7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:34.040082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-65b94c26-a392-44ad-b177-1481f32002a7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:34.052412 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65b94c26-a392-44ad-b177-1481f32002a7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:34.054177 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65b94c26-a392-44ad-b177-1481f32002a7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:34.055873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65b94c26-a392-44ad-b177-1481f32002a7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:34.057236 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65b94c26-a392-44ad-b177-1481f32002a7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:34.257986 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-afa90073-c269-48d8-8669-a25c14b1dfe5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:34.260260 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-afa90073-c269-48d8-8669-a25c14b1dfe5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:34.275800 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afa90073-c269-48d8-8669-a25c14b1dfe5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:34.276910 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afa90073-c269-48d8-8669-a25c14b1dfe5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:34.279135 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afa90073-c269-48d8-8669-a25c14b1dfe5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:34.280236 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afa90073-c269-48d8-8669-a25c14b1dfe5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:34.478254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-65b94c26-a392-44ad-b177-1481f32002a7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:34.506489 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-65b94c26-a392-44ad-b177-1481f32002a7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.475680 Jul 12 18:27:34.520599 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 128/269] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:34 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:34.581731 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-afa90073-c269-48d8-8669-a25c14b1dfe5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:34.595671 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-afa90073-c269-48d8-8669-a25c14b1dfe5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:34.598761 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-afa90073-c269-48d8-8669-a25c14b1dfe5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:34.600279 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-afa90073-c269-48d8-8669-a25c14b1dfe5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.351714 Jul 12 18:27:34.612128 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 142/270] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:34 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:27:34.655431 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4d20d047-10f6-4a2d-babd-4201da0ff6de tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:34.656640 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4d20d047-10f6-4a2d-babd-4201da0ff6de tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:34.680343 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d20d047-10f6-4a2d-babd-4201da0ff6de tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:34.681231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d20d047-10f6-4a2d-babd-4201da0ff6de tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:34.683165 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d20d047-10f6-4a2d-babd-4201da0ff6de tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:34.685058 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d20d047-10f6-4a2d-babd-4201da0ff6de tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:35.023418 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4d20d047-10f6-4a2d-babd-4201da0ff6de tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:35.037429 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4d20d047-10f6-4a2d-babd-4201da0ff6de tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.389149 Jul 12 18:27:35.038001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 129/271] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:34 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:35.536211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-10de035d-3d45-4989-bc4f-9fd820b1581d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:35.537593 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-10de035d-3d45-4989-bc4f-9fd820b1581d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:35.546703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-10de035d-3d45-4989-bc4f-9fd820b1581d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:35.547403 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-10de035d-3d45-4989-bc4f-9fd820b1581d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:35.548691 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-10de035d-3d45-4989-bc4f-9fd820b1581d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:35.549274 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-10de035d-3d45-4989-bc4f-9fd820b1581d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:35.624740 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-46ee1b0d-cfbd-4025-9d52-3e6b9198d87a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:35.625873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-46ee1b0d-cfbd-4025-9d52-3e6b9198d87a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:35.657385 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ee1b0d-cfbd-4025-9d52-3e6b9198d87a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:35.658281 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ee1b0d-cfbd-4025-9d52-3e6b9198d87a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:35.659696 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ee1b0d-cfbd-4025-9d52-3e6b9198d87a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:35.666379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ee1b0d-cfbd-4025-9d52-3e6b9198d87a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:35.911316 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-10de035d-3d45-4989-bc4f-9fd820b1581d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:35.931774 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-10de035d-3d45-4989-bc4f-9fd820b1581d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.400165 Jul 12 18:27:35.945565 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 143/272] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:35 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:36.063747 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8d1a7b25-78ab-49ba-9c8f-963b5ccd7559 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:36.064454 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8d1a7b25-78ab-49ba-9c8f-963b5ccd7559 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:36.074082 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8d1a7b25-78ab-49ba-9c8f-963b5ccd7559 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:36.076540 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8d1a7b25-78ab-49ba-9c8f-963b5ccd7559 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:36.077730 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8d1a7b25-78ab-49ba-9c8f-963b5ccd7559 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:36.078499 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8d1a7b25-78ab-49ba-9c8f-963b5ccd7559 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:36.196154 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-46ee1b0d-cfbd-4025-9d52-3e6b9198d87a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:36.209444 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-46ee1b0d-cfbd-4025-9d52-3e6b9198d87a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:36.211897 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-46ee1b0d-cfbd-4025-9d52-3e6b9198d87a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:36.214380 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-46ee1b0d-cfbd-4025-9d52-3e6b9198d87a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.597574 Jul 12 18:27:36.215804 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 130/273] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:35 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:36.278959 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8d1a7b25-78ab-49ba-9c8f-963b5ccd7559 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:36.293781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8d1a7b25-78ab-49ba-9c8f-963b5ccd7559 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.234149 Jul 12 18:27:36.308860 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 144/274] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:36 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:27:36.961080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-14dc2658-6ddb-4676-b966-57f287ac8ace tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:36.962174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-14dc2658-6ddb-4676-b966-57f287ac8ace tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:36.976358 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-14dc2658-6ddb-4676-b966-57f287ac8ace tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:36.977163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-14dc2658-6ddb-4676-b966-57f287ac8ace tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:36.978864 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-14dc2658-6ddb-4676-b966-57f287ac8ace tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:36.979672 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-14dc2658-6ddb-4676-b966-57f287ac8ace tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:37.250001 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8f6cb5be-492f-490b-ad16-105e368c22da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:37.252082 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8f6cb5be-492f-490b-ad16-105e368c22da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:37.266066 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8f6cb5be-492f-490b-ad16-105e368c22da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:37.276196 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8f6cb5be-492f-490b-ad16-105e368c22da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:37.277949 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8f6cb5be-492f-490b-ad16-105e368c22da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:37.280779 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8f6cb5be-492f-490b-ad16-105e368c22da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:37.467808 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-14dc2658-6ddb-4676-b966-57f287ac8ace tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:37.476975 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-14dc2658-6ddb-4676-b966-57f287ac8ace tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.529837 Jul 12 18:27:37.500120 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 131/275] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:36 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:37.500120 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-abd925ef-f2dc-4b4d-a482-be8f092e1c5d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:37.500120 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-abd925ef-f2dc-4b4d-a482-be8f092e1c5d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:37.502805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abd925ef-f2dc-4b4d-a482-be8f092e1c5d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:37.503501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abd925ef-f2dc-4b4d-a482-be8f092e1c5d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:37.504885 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abd925ef-f2dc-4b4d-a482-be8f092e1c5d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:37.505516 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abd925ef-f2dc-4b4d-a482-be8f092e1c5d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:37.508288 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8f6cb5be-492f-490b-ad16-105e368c22da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:37.517905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8f6cb5be-492f-490b-ad16-105e368c22da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:37.520535 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8f6cb5be-492f-490b-ad16-105e368c22da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:37.523239 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8f6cb5be-492f-490b-ad16-105e368c22da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.279046 Jul 12 18:27:37.524048 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 145/276] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:37 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:27:37.722569 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-abd925ef-f2dc-4b4d-a482-be8f092e1c5d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:37.734661 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-abd925ef-f2dc-4b4d-a482-be8f092e1c5d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.243016 Jul 12 18:27:37.736327 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 132/277] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:37 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:38.221398 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-1858aeac-a515-404e-802a-cef2a4f01705 req-1cd09f11-e82f-4bbb-9308-9ce1854fb39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7062eaf-78a1-4879-9edb-6465141472bc", "name": "network-vif-plugged", "status": "completed", "tag": "481a00ce-3877-4a82-887d-6774ec1254f9"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:38.252394 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-1858aeac-a515-404e-802a-cef2a4f01705 req-1cd09f11-e82f-4bbb-9308-9ce1854fb39b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:38.253091 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-1858aeac-a515-404e-802a-cef2a4f01705 req-1cd09f11-e82f-4bbb-9308-9ce1854fb39b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:38.283334 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-1858aeac-a515-404e-802a-cef2a4f01705 req-1cd09f11-e82f-4bbb-9308-9ce1854fb39b service nova] Creating event network-vif-plugged:481a00ce-3877-4a82-887d-6774ec1254f9 for instance f7062eaf-78a1-4879-9edb-6465141472bc on hv-cinder-84488 Jul 12 18:27:38.292641 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-1858aeac-a515-404e-802a-cef2a4f01705 req-1cd09f11-e82f-4bbb-9308-9ce1854fb39b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078153 Jul 12 18:27:38.293764 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 146/278] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:27:38.502067 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a7060b8c-6c36-48dc-afb4-0035e84fc2fa tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:38.503413 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a7060b8c-6c36-48dc-afb4-0035e84fc2fa tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:38.513431 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7060b8c-6c36-48dc-afb4-0035e84fc2fa tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:38.523770 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7060b8c-6c36-48dc-afb4-0035e84fc2fa tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:38.523770 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7060b8c-6c36-48dc-afb4-0035e84fc2fa tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:38.523770 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7060b8c-6c36-48dc-afb4-0035e84fc2fa tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:38.572491 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8d3047ec-5312-4901-b3fa-53e106ad1d17 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:38.590718 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8d3047ec-5312-4901-b3fa-53e106ad1d17 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:38.605200 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8d3047ec-5312-4901-b3fa-53e106ad1d17 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:38.606236 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8d3047ec-5312-4901-b3fa-53e106ad1d17 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:38.607828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8d3047ec-5312-4901-b3fa-53e106ad1d17 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:38.608856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8d3047ec-5312-4901-b3fa-53e106ad1d17 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:38.845223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a7060b8c-6c36-48dc-afb4-0035e84fc2fa tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:38.862677 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a7060b8c-6c36-48dc-afb4-0035e84fc2fa tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.366862 Jul 12 18:27:38.863145 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8d3047ec-5312-4901-b3fa-53e106ad1d17 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:38.863910 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 133/279] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:38 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:38.881556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8d3047ec-5312-4901-b3fa-53e106ad1d17 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:38.883795 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-443983c7-ae64-4231-b3ea-5e81a7246c07 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:38.885050 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-443983c7-ae64-4231-b3ea-5e81a7246c07 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:38.893716 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8d3047ec-5312-4901-b3fa-53e106ad1d17 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:38.895872 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8d3047ec-5312-4901-b3fa-53e106ad1d17 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1745 microversion: 2.20 time: 0.337632 Jul 12 18:27:38.899016 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 147/280] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:38 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1745 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:38.902454 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-443983c7-ae64-4231-b3ea-5e81a7246c07 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:38.913833 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-443983c7-ae64-4231-b3ea-5e81a7246c07 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:38.913833 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-443983c7-ae64-4231-b3ea-5e81a7246c07 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:38.913833 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-443983c7-ae64-4231-b3ea-5e81a7246c07 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:39.197217 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-443983c7-ae64-4231-b3ea-5e81a7246c07 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:39.210460 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-443983c7-ae64-4231-b3ea-5e81a7246c07 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.345039 Jul 12 18:27:39.211274 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 134/281] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:38 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:39.882140 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c95b261a-0daa-473c-af95-5186ad8e582f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:39.887442 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c95b261a-0daa-473c-af95-5186ad8e582f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:39.887716 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1591363689", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:39.889956 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c95b261a-0daa-473c-af95-5186ad8e582f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:39.890484 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c95b261a-0daa-473c-af95-5186ad8e582f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:39.891406 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c95b261a-0daa-473c-af95-5186ad8e582f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:39.891941 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c95b261a-0daa-473c-af95-5186ad8e582f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:39.962283 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] validate_networks() for None {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:27:40.199779 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c95b261a-0daa-473c-af95-5186ad8e582f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:40.210061 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c95b261a-0daa-473c-af95-5186ad8e582f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.333536 Jul 12 18:27:40.229948 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 148/282] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:39 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:40.233607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-95544b5d-cf08-4af0-a81f-93617a691498 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:40.237654 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-95544b5d-cf08-4af0-a81f-93617a691498 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:40.250292 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:40.267337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-95544b5d-cf08-4af0-a81f-93617a691498 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:40.268832 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-95544b5d-cf08-4af0-a81f-93617a691498 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:40.274290 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-95544b5d-cf08-4af0-a81f-93617a691498 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:40.275227 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-95544b5d-cf08-4af0-a81f-93617a691498 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:40.805148 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-95544b5d-cf08-4af0-a81f-93617a691498 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:40.843107 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-95544b5d-cf08-4af0-a81f-93617a691498 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:40.849661 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-95544b5d-cf08-4af0-a81f-93617a691498 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:40.865074 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-95544b5d-cf08-4af0-a81f-93617a691498 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1745 microversion: 2.20 time: 0.638188 Jul 12 18:27:40.866098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 149/283] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:40 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1745 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:40.874133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bc8e8091-4c3f-4f25-a21e-1e907f9f3a87 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:40.882603 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-bc8e8091-4c3f-4f25-a21e-1e907f9f3a87 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:40.920904 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc8e8091-4c3f-4f25-a21e-1e907f9f3a87 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:40.924099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc8e8091-4c3f-4f25-a21e-1e907f9f3a87 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:40.925233 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc8e8091-4c3f-4f25-a21e-1e907f9f3a87 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:40.929117 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc8e8091-4c3f-4f25-a21e-1e907f9f3a87 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:41.093849 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:27:41.095779 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:27:41.097190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:27:41.100205 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:27:41.107112 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:27:41.132724 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:41.133842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:41.136098 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:41.137424 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:41.195877 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Getting quotas for project e838bf49cff94199ac354e9f42d42af2. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:27:41.210367 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Getting quotas for user 6767e4eeaf094d61a75469e9c7d66eac and project e838bf49cff94199ac354e9f42d42af2. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:27:41.226753 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:27:41.229820 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:27:41.368688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-bc8e8091-4c3f-4f25-a21e-1e907f9f3a87 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:41.378129 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bc8e8091-4c3f-4f25-a21e-1e907f9f3a87 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.509646 Jul 12 18:27:41.378721 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 150/284] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:40 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:41.393367 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3618234a-ee56-4f9e-8d16-1e735c504d89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:41.400250 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3618234a-ee56-4f9e-8d16-1e735c504d89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:41.401768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3618234a-ee56-4f9e-8d16-1e735c504d89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:41.402222 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3618234a-ee56-4f9e-8d16-1e735c504d89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:41.403004 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3618234a-ee56-4f9e-8d16-1e735c504d89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:41.403432 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3618234a-ee56-4f9e-8d16-1e735c504d89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:41.540843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d52b75f1-6d4e-4f5a-8542-ce70c064a8b5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661030 Jul 12 18:27:41.542104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 135/285] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:27:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:27:41.553090 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d97c17d3-0858-4ebd-b4b3-f169911f71fc tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:41.554115 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d97c17d3-0858-4ebd-b4b3-f169911f71fc tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:41.616827 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d97c17d3-0858-4ebd-b4b3-f169911f71fc tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:41.626790 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d97c17d3-0858-4ebd-b4b3-f169911f71fc tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1215 microversion: 2.1 time: 0.078547 Jul 12 18:27:41.644705 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 136/286] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:41 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:41.700521 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3618234a-ee56-4f9e-8d16-1e735c504d89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:41.746743 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3618234a-ee56-4f9e-8d16-1e735c504d89 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1371 microversion: 2.1 time: 0.356552 Jul 12 18:27:41.747806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 151/287] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:41 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:41.894962 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9d6962fe-40e8-4c42-9510-c071916610ad tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:41.894962 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9d6962fe-40e8-4c42-9510-c071916610ad tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:41.902694 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d6962fe-40e8-4c42-9510-c071916610ad tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:41.903141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d6962fe-40e8-4c42-9510-c071916610ad tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:41.903930 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d6962fe-40e8-4c42-9510-c071916610ad tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:41.904410 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d6962fe-40e8-4c42-9510-c071916610ad tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:42.233735 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9d6962fe-40e8-4c42-9510-c071916610ad tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:42.267387 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9d6962fe-40e8-4c42-9510-c071916610ad tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:42.273536 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9d6962fe-40e8-4c42-9510-c071916610ad tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:42.275530 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9d6962fe-40e8-4c42-9510-c071916610ad tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.385195 Jul 12 18:27:42.301544 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 137/288] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:41 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:42.396526 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b75441c0-3c7b-4d36-ab3b-5eac93f8395d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:42.397898 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b75441c0-3c7b-4d36-ab3b-5eac93f8395d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:42.406445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b75441c0-3c7b-4d36-ab3b-5eac93f8395d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:42.410250 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b75441c0-3c7b-4d36-ab3b-5eac93f8395d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:42.411618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b75441c0-3c7b-4d36-ab3b-5eac93f8395d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:42.426720 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b75441c0-3c7b-4d36-ab3b-5eac93f8395d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:42.545924 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-f5a3efc1-33a2-4731-a980-1df9cdd5c7b2 req-28ad43df-ed72-4698-a94d-e1c6418820e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa637fee-4d51-4d79-aed2-ed75805784bf", "name": "network-vif-plugged", "status": "completed", "tag": "2f9bf653-860b-4ebb-ba76-4f6b0284e567"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:42.592108 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f5a3efc1-33a2-4731-a980-1df9cdd5c7b2 req-28ad43df-ed72-4698-a94d-e1c6418820e8 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:42.594502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f5a3efc1-33a2-4731-a980-1df9cdd5c7b2 req-28ad43df-ed72-4698-a94d-e1c6418820e8 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:42.624656 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:42.687138 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-f5a3efc1-33a2-4731-a980-1df9cdd5c7b2 req-28ad43df-ed72-4698-a94d-e1c6418820e8 service nova] Creating event network-vif-plugged:2f9bf653-860b-4ebb-ba76-4f6b0284e567 for instance fa637fee-4d51-4d79-aed2-ed75805784bf on hv-cinder-84488 Jul 12 18:27:42.702977 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-f5a3efc1-33a2-4731-a980-1df9cdd5c7b2 req-28ad43df-ed72-4698-a94d-e1c6418820e8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163256 Jul 12 18:27:42.705757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 138/289] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:27:42.718752 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5fa7be7c-4091-4d8f-bc28-f32209036566 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:42.720561 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5fa7be7c-4091-4d8f-bc28-f32209036566 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:42.951810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5fa7be7c-4091-4d8f-bc28-f32209036566 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:42.964267 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5fa7be7c-4091-4d8f-bc28-f32209036566 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1215 microversion: 2.1 time: 0.255420 Jul 12 18:27:42.971593 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 139/290] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:42 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1215 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:42.990507 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4372796f-af9c-4f32-bfdd-d5a80681db83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:42.991400 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4372796f-af9c-4f32-bfdd-d5a80681db83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:43.013167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4372796f-af9c-4f32-bfdd-d5a80681db83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:43.014303 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4372796f-af9c-4f32-bfdd-d5a80681db83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:43.015307 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4372796f-af9c-4f32-bfdd-d5a80681db83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:43.015734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4372796f-af9c-4f32-bfdd-d5a80681db83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:43.058987 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b75441c0-3c7b-4d36-ab3b-5eac93f8395d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:43.072927 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b75441c0-3c7b-4d36-ab3b-5eac93f8395d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.681560 Jul 12 18:27:43.074349 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 152/291] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:42 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:43.305057 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-689559b4-f460-4bf2-aa55-27c663ec45aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:43.306046 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-689559b4-f460-4bf2-aa55-27c663ec45aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:43.315314 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-689559b4-f460-4bf2-aa55-27c663ec45aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:43.315858 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-689559b4-f460-4bf2-aa55-27c663ec45aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:43.319559 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-689559b4-f460-4bf2-aa55-27c663ec45aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:43.320174 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-689559b4-f460-4bf2-aa55-27c663ec45aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:43.469184 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4372796f-af9c-4f32-bfdd-d5a80681db83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:43.535271 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4372796f-af9c-4f32-bfdd-d5a80681db83 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1564 microversion: 2.1 time: 0.560811 Jul 12 18:27:43.539459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 140/292] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:42 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1564 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:43.573988 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-32c7d2ae-5f70-45f7-a8eb-35e4c73be95d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:43.578144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-32c7d2ae-5f70-45f7-a8eb-35e4c73be95d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:43.606145 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-32c7d2ae-5f70-45f7-a8eb-35e4c73be95d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:43.607187 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-32c7d2ae-5f70-45f7-a8eb-35e4c73be95d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:43.618793 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-32c7d2ae-5f70-45f7-a8eb-35e4c73be95d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:43.619543 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-32c7d2ae-5f70-45f7-a8eb-35e4c73be95d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:43.726616 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-689559b4-f460-4bf2-aa55-27c663ec45aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:43.738380 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-689559b4-f460-4bf2-aa55-27c663ec45aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:43.740610 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-689559b4-f460-4bf2-aa55-27c663ec45aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:43.742152 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-689559b4-f460-4bf2-aa55-27c663ec45aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.443562 Jul 12 18:27:43.759668 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 153/293] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:43 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:43.993442 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-edc43450-74b2-4dd5-8684-83925f2de207 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:43.994418 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-edc43450-74b2-4dd5-8684-83925f2de207 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:44.005626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-32c7d2ae-5f70-45f7-a8eb-35e4c73be95d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.450912 Jul 12 18:27:44.008245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 141/294] 10.222.0.47 () {58 vars in 1274 bytes} [Tue Jul 12 18:27:43 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-interface => generated 284 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:27:44.049003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-edc43450-74b2-4dd5-8684-83925f2de207 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:44.049003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-edc43450-74b2-4dd5-8684-83925f2de207 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:44.049003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-edc43450-74b2-4dd5-8684-83925f2de207 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:44.049003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-edc43450-74b2-4dd5-8684-83925f2de207 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:44.101111 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0ad3634b-da2b-44b1-87e5-8d958f4bee57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:44.101935 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0ad3634b-da2b-44b1-87e5-8d958f4bee57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:44.128254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ad3634b-da2b-44b1-87e5-8d958f4bee57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:44.140934 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ad3634b-da2b-44b1-87e5-8d958f4bee57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:44.145771 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ad3634b-da2b-44b1-87e5-8d958f4bee57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:44.148267 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ad3634b-da2b-44b1-87e5-8d958f4bee57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:44.502630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-edc43450-74b2-4dd5-8684-83925f2de207 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:44.516721 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-edc43450-74b2-4dd5-8684-83925f2de207 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1211 microversion: 2.1 time: 0.532826 Jul 12 18:27:44.520201 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 154/295] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:43 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1211 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:44.767685 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-51308136-2e3f-45ba-a3c8-6fe57a257fe7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:44.770856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-51308136-2e3f-45ba-a3c8-6fe57a257fe7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:44.811973 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51308136-2e3f-45ba-a3c8-6fe57a257fe7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:44.812721 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51308136-2e3f-45ba-a3c8-6fe57a257fe7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:44.813792 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51308136-2e3f-45ba-a3c8-6fe57a257fe7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:44.814416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51308136-2e3f-45ba-a3c8-6fe57a257fe7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:44.930039 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0ad3634b-da2b-44b1-87e5-8d958f4bee57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:44.993260 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0ad3634b-da2b-44b1-87e5-8d958f4bee57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 0.894781 Jul 12 18:27:44.997647 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 142/296] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:44 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:27:45.545059 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d438abb2-b548-49c1-be41-c49c8551fd0a tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:45.549301 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d438abb2-b548-49c1-be41-c49c8551fd0a tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:45.563747 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d438abb2-b548-49c1-be41-c49c8551fd0a tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:45.565119 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d438abb2-b548-49c1-be41-c49c8551fd0a tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:45.568345 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d438abb2-b548-49c1-be41-c49c8551fd0a tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:45.569498 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d438abb2-b548-49c1-be41-c49c8551fd0a tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:45.857365 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d438abb2-b548-49c1-be41-c49c8551fd0a tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:45.895046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d438abb2-b548-49c1-be41-c49c8551fd0a tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1275 microversion: 2.1 time: 0.361659 Jul 12 18:27:45.906055 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 143/297] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:45 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1275 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:46.034008 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d9275e2c-5ea7-4b4c-8e5b-ea4698b3f8ee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:46.046654 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d9275e2c-5ea7-4b4c-8e5b-ea4698b3f8ee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:46.081517 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d9275e2c-5ea7-4b4c-8e5b-ea4698b3f8ee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:46.088118 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d9275e2c-5ea7-4b4c-8e5b-ea4698b3f8ee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:46.088118 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d9275e2c-5ea7-4b4c-8e5b-ea4698b3f8ee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:46.088118 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d9275e2c-5ea7-4b4c-8e5b-ea4698b3f8ee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:46.121857 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-51308136-2e3f-45ba-a3c8-6fe57a257fe7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:46.138521 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-51308136-2e3f-45ba-a3c8-6fe57a257fe7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:46.140635 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-51308136-2e3f-45ba-a3c8-6fe57a257fe7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:46.147717 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-51308136-2e3f-45ba-a3c8-6fe57a257fe7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 1.384102 Jul 12 18:27:46.148690 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 155/298] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:44 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:46.915536 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7f7eb108-e55c-4387-8d76-c7a2276b0434 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:46.916861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7f7eb108-e55c-4387-8d76-c7a2276b0434 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:46.928615 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7f7eb108-e55c-4387-8d76-c7a2276b0434 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:46.931698 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7f7eb108-e55c-4387-8d76-c7a2276b0434 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:46.934339 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7f7eb108-e55c-4387-8d76-c7a2276b0434 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:46.935057 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7f7eb108-e55c-4387-8d76-c7a2276b0434 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:47.218569 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d9275e2c-5ea7-4b4c-8e5b-ea4698b3f8ee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:47.256001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d9275e2c-5ea7-4b4c-8e5b-ea4698b3f8ee tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1722 microversion: 2.1 time: 1.235118 Jul 12 18:27:47.258410 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 144/299] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:46 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1722 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:27:47.277995 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-835f2431-0007-4b3d-a1f9-6ffee4ae8da0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:47.280427 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-835f2431-0007-4b3d-a1f9-6ffee4ae8da0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:47.299848 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-835f2431-0007-4b3d-a1f9-6ffee4ae8da0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:47.304207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-835f2431-0007-4b3d-a1f9-6ffee4ae8da0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:47.307964 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-835f2431-0007-4b3d-a1f9-6ffee4ae8da0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:47.309285 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-835f2431-0007-4b3d-a1f9-6ffee4ae8da0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:47.506071 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7f7eb108-e55c-4387-8d76-c7a2276b0434 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:47.528712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7f7eb108-e55c-4387-8d76-c7a2276b0434 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1273 microversion: 2.1 time: 0.613973 Jul 12 18:27:47.540583 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 156/300] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:46 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1273 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:47.943427 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-6357bd42-ce58-4c1e-8e66-0b51f6212a65 req-a20028ff-e08b-4ca7-93e5-7579b7cf61e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7062eaf-78a1-4879-9edb-6465141472bc", "tag": "481a00ce-3877-4a82-887d-6774ec1254f9"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:47.953610 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-6357bd42-ce58-4c1e-8e66-0b51f6212a65 req-a20028ff-e08b-4ca7-93e5-7579b7cf61e9 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:47.954056 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-6357bd42-ce58-4c1e-8e66-0b51f6212a65 req-a20028ff-e08b-4ca7-93e5-7579b7cf61e9 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:47.971691 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-6357bd42-ce58-4c1e-8e66-0b51f6212a65 req-a20028ff-e08b-4ca7-93e5-7579b7cf61e9 service nova] Creating event network-changed:481a00ce-3877-4a82-887d-6774ec1254f9 for instance f7062eaf-78a1-4879-9edb-6465141472bc on hv-cinder-84488 Jul 12 18:27:47.980871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-6357bd42-ce58-4c1e-8e66-0b51f6212a65 req-a20028ff-e08b-4ca7-93e5-7579b7cf61e9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040421 Jul 12 18:27:47.983827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 157/301] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:27:48.277856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f5521252-06bf-473a-b4c6-483e34ec63c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:48.279086 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f5521252-06bf-473a-b4c6-483e34ec63c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:48.289406 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f5521252-06bf-473a-b4c6-483e34ec63c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:48.290249 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f5521252-06bf-473a-b4c6-483e34ec63c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:48.292090 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f5521252-06bf-473a-b4c6-483e34ec63c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:48.293245 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f5521252-06bf-473a-b4c6-483e34ec63c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:48.587435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f5521252-06bf-473a-b4c6-483e34ec63c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:48.601307 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f5521252-06bf-473a-b4c6-483e34ec63c9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1699 microversion: 2.1 time: 0.327477 Jul 12 18:27:48.611852 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 158/302] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:48 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1699 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:48.619452 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c4191ab1-9324-4f1d-a8ac-0c9b2565043b tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:48.621407 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c4191ab1-9324-4f1d-a8ac-0c9b2565043b tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:48.641467 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c4191ab1-9324-4f1d-a8ac-0c9b2565043b tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:48.643139 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c4191ab1-9324-4f1d-a8ac-0c9b2565043b tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:48.645752 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c4191ab1-9324-4f1d-a8ac-0c9b2565043b tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:48.646273 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c4191ab1-9324-4f1d-a8ac-0c9b2565043b tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:48.693850 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=100 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:48.757216 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-835f2431-0007-4b3d-a1f9-6ffee4ae8da0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:48.758125 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c4191ab1-9324-4f1d-a8ac-0c9b2565043b tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:48.770422 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c4191ab1-9324-4f1d-a8ac-0c9b2565043b tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1273 microversion: 2.1 time: 0.162909 Jul 12 18:27:48.781930 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 159/303] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:48 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:48.788298 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-835f2431-0007-4b3d-a1f9-6ffee4ae8da0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:48.793462 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-835f2431-0007-4b3d-a1f9-6ffee4ae8da0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:48.797658 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ac24ccf4-dca7-4769-9ab6-300ed64cf260 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:48.807388 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-835f2431-0007-4b3d-a1f9-6ffee4ae8da0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 1.545616 Jul 12 18:27:48.820530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac24ccf4-dca7-4769-9ab6-300ed64cf260 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:48.820530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac24ccf4-dca7-4769-9ab6-300ed64cf260 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:48.834283 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 145/304] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:47 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:49.015460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ac24ccf4-dca7-4769-9ab6-300ed64cf260 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Going to try to start instance {{(pid=118411) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 18:27:49.306012 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ac24ccf4-dca7-4769-9ab6-300ed64cf260 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "POST /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/action" status: 202 len: 0 microversion: 2.1 time: 0.522055 Jul 12 18:27:49.310950 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 160/305] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:27:48 2022] POST /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:27:49.325440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e95f14d3-61c8-4992-8042-31faa432087f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:49.328808 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e95f14d3-61c8-4992-8042-31faa432087f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:49.380672 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e95f14d3-61c8-4992-8042-31faa432087f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:49.381210 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e95f14d3-61c8-4992-8042-31faa432087f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:49.382018 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e95f14d3-61c8-4992-8042-31faa432087f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:49.382446 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e95f14d3-61c8-4992-8042-31faa432087f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:49.827653 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1317ecec-6a86-4522-968e-91fd6c871be1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:49.830166 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1317ecec-6a86-4522-968e-91fd6c871be1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:49.848095 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1317ecec-6a86-4522-968e-91fd6c871be1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:49.849459 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1317ecec-6a86-4522-968e-91fd6c871be1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:49.851265 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1317ecec-6a86-4522-968e-91fd6c871be1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:49.853147 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1317ecec-6a86-4522-968e-91fd6c871be1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:50.062432 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1317ecec-6a86-4522-968e-91fd6c871be1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:50.082976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1317ecec-6a86-4522-968e-91fd6c871be1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1273 microversion: 2.1 time: 0.296879 Jul 12 18:27:50.086194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 161/306] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:49 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1273 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:27:50.099777 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-398787a8-04ca-41b6-9e0f-7019659f6327 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:50.111894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-398787a8-04ca-41b6-9e0f-7019659f6327 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:50.126832 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-398787a8-04ca-41b6-9e0f-7019659f6327 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:50.135861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-398787a8-04ca-41b6-9e0f-7019659f6327 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:50.138255 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-398787a8-04ca-41b6-9e0f-7019659f6327 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:50.139365 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-398787a8-04ca-41b6-9e0f-7019659f6327 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:50.766258 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-398787a8-04ca-41b6-9e0f-7019659f6327 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:50.781457 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-398787a8-04ca-41b6-9e0f-7019659f6327 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:50.789342 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-398787a8-04ca-41b6-9e0f-7019659f6327 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:50.797373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-398787a8-04ca-41b6-9e0f-7019659f6327 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.708418 Jul 12 18:27:50.812423 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 162/307] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:50 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:51.068384 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e95f14d3-61c8-4992-8042-31faa432087f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:51.068384 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e95f14d3-61c8-4992-8042-31faa432087f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1708 microversion: 2.1 time: 1.734165 Jul 12 18:27:51.068384 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 146/308] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:49 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1708 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:51.110307 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-467c8aa1-fb76-49b1-b6d4-fd4855174f67 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:51.112797 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-467c8aa1-fb76-49b1-b6d4-fd4855174f67 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:51.131825 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-467c8aa1-fb76-49b1-b6d4-fd4855174f67 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:51.180789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-467c8aa1-fb76-49b1-b6d4-fd4855174f67 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:51.180789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-467c8aa1-fb76-49b1-b6d4-fd4855174f67 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:51.183385 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-467c8aa1-fb76-49b1-b6d4-fd4855174f67 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:51.839689 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b343613d-e119-4492-862e-dd5754db0002 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:51.853369 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b343613d-e119-4492-862e-dd5754db0002 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:51.885006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:51.919826 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b343613d-e119-4492-862e-dd5754db0002 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:51.921257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b343613d-e119-4492-862e-dd5754db0002 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:51.945898 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b343613d-e119-4492-862e-dd5754db0002 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:51.947003 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b343613d-e119-4492-862e-dd5754db0002 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:52.354400 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b343613d-e119-4492-862e-dd5754db0002 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:52.363156 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b343613d-e119-4492-862e-dd5754db0002 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:52.365051 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b343613d-e119-4492-862e-dd5754db0002 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:52.366270 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b343613d-e119-4492-862e-dd5754db0002 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.536483 Jul 12 18:27:52.366839 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 147/309] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:51 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:52.386500 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-de20ba6b-7a5e-41aa-9567-6ce194f3da76 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:52.387587 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-de20ba6b-7a5e-41aa-9567-6ce194f3da76 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:52.398283 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de20ba6b-7a5e-41aa-9567-6ce194f3da76 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:52.398738 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de20ba6b-7a5e-41aa-9567-6ce194f3da76 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:52.399532 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de20ba6b-7a5e-41aa-9567-6ce194f3da76 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:52.399961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de20ba6b-7a5e-41aa-9567-6ce194f3da76 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:52.451554 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-467c8aa1-fb76-49b1-b6d4-fd4855174f67 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:52.479762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-467c8aa1-fb76-49b1-b6d4-fd4855174f67 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1315 microversion: 2.1 time: 1.379472 Jul 12 18:27:52.500032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 163/310] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:51 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1315 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:52.958349 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=10 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:53.050447 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-de20ba6b-7a5e-41aa-9567-6ce194f3da76 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:53.062410 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-de20ba6b-7a5e-41aa-9567-6ce194f3da76 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1708 microversion: 2.1 time: 0.694247 Jul 12 18:27:53.068158 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 148/311] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:52 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1708 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:53.386877 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-dc4839f6-ddd0-4b9c-a53d-d61621bdea68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:53.387501 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-dc4839f6-ddd0-4b9c-a53d-d61621bdea68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:53.398686 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc4839f6-ddd0-4b9c-a53d-d61621bdea68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:53.409327 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc4839f6-ddd0-4b9c-a53d-d61621bdea68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:53.411044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc4839f6-ddd0-4b9c-a53d-d61621bdea68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:53.411649 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dc4839f6-ddd0-4b9c-a53d-d61621bdea68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:53.515661 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-07daea93-59ed-4cc4-821f-8ecbfc1f1718 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:53.518402 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-07daea93-59ed-4cc4-821f-8ecbfc1f1718 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:53.530088 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-07daea93-59ed-4cc4-821f-8ecbfc1f1718 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:53.530989 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-07daea93-59ed-4cc4-821f-8ecbfc1f1718 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:53.533951 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-07daea93-59ed-4cc4-821f-8ecbfc1f1718 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:53.534741 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-07daea93-59ed-4cc4-821f-8ecbfc1f1718 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:53.844750 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-dc4839f6-ddd0-4b9c-a53d-d61621bdea68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:53.863129 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-dc4839f6-ddd0-4b9c-a53d-d61621bdea68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:53.864969 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-dc4839f6-ddd0-4b9c-a53d-d61621bdea68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:53.867549 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-dc4839f6-ddd0-4b9c-a53d-d61621bdea68 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.483492 Jul 12 18:27:53.867549 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 164/312] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:53 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:54.090827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-033f868f-eb7a-47c1-ae80-a19f72d37f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:54.091765 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-033f868f-eb7a-47c1-ae80-a19f72d37f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:54.103134 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-033f868f-eb7a-47c1-ae80-a19f72d37f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:54.103603 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-033f868f-eb7a-47c1-ae80-a19f72d37f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:54.104439 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-033f868f-eb7a-47c1-ae80-a19f72d37f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:54.109996 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-033f868f-eb7a-47c1-ae80-a19f72d37f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:54.117438 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-07daea93-59ed-4cc4-821f-8ecbfc1f1718 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:54.135307 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-07daea93-59ed-4cc4-821f-8ecbfc1f1718 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1315 microversion: 2.1 time: 0.624455 Jul 12 18:27:54.136174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 149/313] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:53 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:27:54.536407 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-033f868f-eb7a-47c1-ae80-a19f72d37f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:54.551792 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-033f868f-eb7a-47c1-ae80-a19f72d37f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1712 microversion: 2.1 time: 0.465346 Jul 12 18:27:54.557832 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 165/314] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:54 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1712 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:54.904046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9a2e2cdf-7c89-49a0-8a72-7fb6635745f5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:54.914814 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9a2e2cdf-7c89-49a0-8a72-7fb6635745f5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:54.957810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a2e2cdf-7c89-49a0-8a72-7fb6635745f5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:54.968278 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a2e2cdf-7c89-49a0-8a72-7fb6635745f5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:54.975885 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a2e2cdf-7c89-49a0-8a72-7fb6635745f5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:54.975885 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a2e2cdf-7c89-49a0-8a72-7fb6635745f5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:55.154851 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-81eab062-9dbd-4581-87a8-5a3e14cae8f2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:55.155489 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-81eab062-9dbd-4581-87a8-5a3e14cae8f2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:55.165892 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81eab062-9dbd-4581-87a8-5a3e14cae8f2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:55.166238 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81eab062-9dbd-4581-87a8-5a3e14cae8f2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:55.167063 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81eab062-9dbd-4581-87a8-5a3e14cae8f2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:55.167479 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81eab062-9dbd-4581-87a8-5a3e14cae8f2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:55.592464 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-81eab062-9dbd-4581-87a8-5a3e14cae8f2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:55.603869 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-81eab062-9dbd-4581-87a8-5a3e14cae8f2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1315 microversion: 2.1 time: 0.452896 Jul 12 18:27:55.615102 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 166/315] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:55 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:55.679212 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9a2e2cdf-7c89-49a0-8a72-7fb6635745f5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:55.695554 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9a2e2cdf-7c89-49a0-8a72-7fb6635745f5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:55.710749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9a2e2cdf-7c89-49a0-8a72-7fb6635745f5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:55.710749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9a2e2cdf-7c89-49a0-8a72-7fb6635745f5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.828733 Jul 12 18:27:55.723552 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-dc861609-ba7c-4b71-97a8-6cbff818ec88 req-76d3ce35-a084-43bd-a796-783fb5b2ed66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb66512f-3493-4dc5-ab05-79cba34d4a64", "tag": "12aa7995-82df-4878-bf95-52ec2ae06c51"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:27:55.723819 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 150/316] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:54 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:55.743577 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-dc861609-ba7c-4b71-97a8-6cbff818ec88 req-76d3ce35-a084-43bd-a796-783fb5b2ed66 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:55.744447 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-dc861609-ba7c-4b71-97a8-6cbff818ec88 req-76d3ce35-a084-43bd-a796-783fb5b2ed66 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:55.804049 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-dc861609-ba7c-4b71-97a8-6cbff818ec88 req-76d3ce35-a084-43bd-a796-783fb5b2ed66 service nova] Creating event network-changed:12aa7995-82df-4878-bf95-52ec2ae06c51 for instance eb66512f-3493-4dc5-ab05-79cba34d4a64 on hv-cinder-84488 Jul 12 18:27:55.880053 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-dc861609-ba7c-4b71-97a8-6cbff818ec88 req-76d3ce35-a084-43bd-a796-783fb5b2ed66 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162934 Jul 12 18:27:55.891823 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 167/317] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:27:56.625100 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-64946990-dc6e-4d66-a186-870d5582d268 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:56.627292 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-64946990-dc6e-4d66-a186-870d5582d268 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:56.639432 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:56.660076 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64946990-dc6e-4d66-a186-870d5582d268 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:56.661266 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64946990-dc6e-4d66-a186-870d5582d268 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:56.663100 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64946990-dc6e-4d66-a186-870d5582d268 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:56.671385 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64946990-dc6e-4d66-a186-870d5582d268 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:56.752071 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-47003288-6121-47a8-9386-ca4faea908da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:56.765820 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-47003288-6121-47a8-9386-ca4faea908da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:56.812035 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-47003288-6121-47a8-9386-ca4faea908da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:56.829984 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-47003288-6121-47a8-9386-ca4faea908da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:56.832056 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-47003288-6121-47a8-9386-ca4faea908da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:56.842842 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-47003288-6121-47a8-9386-ca4faea908da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:57.294842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-64946990-dc6e-4d66-a186-870d5582d268 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:57.339470 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-64946990-dc6e-4d66-a186-870d5582d268 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1315 microversion: 2.1 time: 0.720893 Jul 12 18:27:57.359775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 151/318] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:56 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:27:57.445566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-47003288-6121-47a8-9386-ca4faea908da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:57.477715 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-47003288-6121-47a8-9386-ca4faea908da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:57.485951 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-47003288-6121-47a8-9386-ca4faea908da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:57.492512 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-47003288-6121-47a8-9386-ca4faea908da tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.752275 Jul 12 18:27:57.492512 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 168/319] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:56 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:58.378029 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-64179304-9ed7-4d33-aec6-68df4738b7d1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:58.389601 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-64179304-9ed7-4d33-aec6-68df4738b7d1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:58.424223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64179304-9ed7-4d33-aec6-68df4738b7d1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:58.425651 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64179304-9ed7-4d33-aec6-68df4738b7d1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:58.430705 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64179304-9ed7-4d33-aec6-68df4738b7d1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:58.431490 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64179304-9ed7-4d33-aec6-68df4738b7d1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:58.509601 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-987d0a8d-2d70-44c7-89fa-dc682f4fe23d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:27:58.510519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-987d0a8d-2d70-44c7-89fa-dc682f4fe23d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:27:58.523916 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-987d0a8d-2d70-44c7-89fa-dc682f4fe23d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:58.526136 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-987d0a8d-2d70-44c7-89fa-dc682f4fe23d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:58.527885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-987d0a8d-2d70-44c7-89fa-dc682f4fe23d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:27:58.529680 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-987d0a8d-2d70-44c7-89fa-dc682f4fe23d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:27:59.103063 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-987d0a8d-2d70-44c7-89fa-dc682f4fe23d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:59.138333 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-987d0a8d-2d70-44c7-89fa-dc682f4fe23d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:59.146036 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-987d0a8d-2d70-44c7-89fa-dc682f4fe23d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:59.148857 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-987d0a8d-2d70-44c7-89fa-dc682f4fe23d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.644482 Jul 12 18:27:59.150531 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 169/320] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:27:58 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:27:59.170144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-64179304-9ed7-4d33-aec6-68df4738b7d1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:27:59.197121 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-64179304-9ed7-4d33-aec6-68df4738b7d1 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1315 microversion: 2.1 time: 0.828956 Jul 12 18:27:59.203469 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 152/321] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:27:58 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1315 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:00.187692 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5aa40032-1c9d-4afe-8ffd-562ed1ea6695 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:00.189462 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5aa40032-1c9d-4afe-8ffd-562ed1ea6695 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:00.226611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a6dfa96d-0cb4-4860-8205-212ffd7be829 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:00.227377 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a6dfa96d-0cb4-4860-8205-212ffd7be829 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:00.236348 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5aa40032-1c9d-4afe-8ffd-562ed1ea6695 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:00.243541 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5aa40032-1c9d-4afe-8ffd-562ed1ea6695 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:00.249154 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5aa40032-1c9d-4afe-8ffd-562ed1ea6695 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:00.249855 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5aa40032-1c9d-4afe-8ffd-562ed1ea6695 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:00.274336 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a6dfa96d-0cb4-4860-8205-212ffd7be829 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:00.275047 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a6dfa96d-0cb4-4860-8205-212ffd7be829 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:00.289475 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a6dfa96d-0cb4-4860-8205-212ffd7be829 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:00.290997 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a6dfa96d-0cb4-4860-8205-212ffd7be829 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:00.715894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5aa40032-1c9d-4afe-8ffd-562ed1ea6695 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:00.738226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5aa40032-1c9d-4afe-8ffd-562ed1ea6695 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:00.743638 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5aa40032-1c9d-4afe-8ffd-562ed1ea6695 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:00.747073 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5aa40032-1c9d-4afe-8ffd-562ed1ea6695 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.569249 Jul 12 18:28:00.749574 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 170/322] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:00 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:00.853178 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a6dfa96d-0cb4-4860-8205-212ffd7be829 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:00.868475 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a6dfa96d-0cb4-4860-8205-212ffd7be829 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1315 microversion: 2.1 time: 0.643308 Jul 12 18:28:00.889259 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 153/323] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:00 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:01.824375 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-02da488f-97c6-49e1-a643-e13819433ba3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:01.825378 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-02da488f-97c6-49e1-a643-e13819433ba3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:01.865920 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02da488f-97c6-49e1-a643-e13819433ba3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:01.869551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02da488f-97c6-49e1-a643-e13819433ba3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:01.870954 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02da488f-97c6-49e1-a643-e13819433ba3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:01.877251 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02da488f-97c6-49e1-a643-e13819433ba3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:01.885665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7ebc13e5-9044-4a07-959a-d63fbe253592 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:01.886828 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7ebc13e5-9044-4a07-959a-d63fbe253592 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:01.898951 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7ebc13e5-9044-4a07-959a-d63fbe253592 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:01.903434 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7ebc13e5-9044-4a07-959a-d63fbe253592 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:01.903434 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7ebc13e5-9044-4a07-959a-d63fbe253592 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:01.903434 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7ebc13e5-9044-4a07-959a-d63fbe253592 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:02.298710 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-02da488f-97c6-49e1-a643-e13819433ba3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:02.311022 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-02da488f-97c6-49e1-a643-e13819433ba3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:02.313195 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-02da488f-97c6-49e1-a643-e13819433ba3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:02.314813 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-02da488f-97c6-49e1-a643-e13819433ba3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.517662 Jul 12 18:28:02.319216 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 171/324] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:01 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:02.387274 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7ebc13e5-9044-4a07-959a-d63fbe253592 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:02.407510 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7ebc13e5-9044-4a07-959a-d63fbe253592 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1315 microversion: 2.1 time: 0.525859 Jul 12 18:28:02.412645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 154/325] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:01 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:03.361509 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5dd29256-98bf-4b92-a8dd-4883462ff474 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:03.365278 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5dd29256-98bf-4b92-a8dd-4883462ff474 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:03.377622 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5dd29256-98bf-4b92-a8dd-4883462ff474 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:03.378796 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5dd29256-98bf-4b92-a8dd-4883462ff474 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:03.380821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5dd29256-98bf-4b92-a8dd-4883462ff474 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:03.381904 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5dd29256-98bf-4b92-a8dd-4883462ff474 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:03.427089 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-01ee748e-adb0-4f15-a22f-9ff7769e6f36 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:03.427919 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-01ee748e-adb0-4f15-a22f-9ff7769e6f36 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:03.442409 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-01ee748e-adb0-4f15-a22f-9ff7769e6f36 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:03.445676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-01ee748e-adb0-4f15-a22f-9ff7769e6f36 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:03.463199 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-01ee748e-adb0-4f15-a22f-9ff7769e6f36 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:03.463651 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-01ee748e-adb0-4f15-a22f-9ff7769e6f36 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:03.797672 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5dd29256-98bf-4b92-a8dd-4883462ff474 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:03.818775 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5dd29256-98bf-4b92-a8dd-4883462ff474 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:03.822711 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5dd29256-98bf-4b92-a8dd-4883462ff474 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:03.825527 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5dd29256-98bf-4b92-a8dd-4883462ff474 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.471301 Jul 12 18:28:03.841483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 172/326] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:03 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:03.881225 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-01ee748e-adb0-4f15-a22f-9ff7769e6f36 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:03.889267 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-01ee748e-adb0-4f15-a22f-9ff7769e6f36 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1315 microversion: 2.1 time: 0.466076 Jul 12 18:28:03.899167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 155/327] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:03 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:04.872765 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5d944923-3250-4e8c-b79c-65bef2af686a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:04.873814 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-38b9f680-ef76-4532-b4d2-3967eca39a4e req-15924cf0-a2c7-4ca1-a743-aba9baa65d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb66512f-3493-4dc5-ab05-79cba34d4a64", "name": "network-vif-plugged", "status": "completed", "tag": "12aa7995-82df-4878-bf95-52ec2ae06c51"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:04.880714 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5d944923-3250-4e8c-b79c-65bef2af686a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:04.911618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d944923-3250-4e8c-b79c-65bef2af686a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:04.921319 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d944923-3250-4e8c-b79c-65bef2af686a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:04.926345 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d944923-3250-4e8c-b79c-65bef2af686a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:04.928106 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d944923-3250-4e8c-b79c-65bef2af686a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:04.932360 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-38b9f680-ef76-4532-b4d2-3967eca39a4e req-15924cf0-a2c7-4ca1-a743-aba9baa65d33 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:04.937526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-38b9f680-ef76-4532-b4d2-3967eca39a4e req-15924cf0-a2c7-4ca1-a743-aba9baa65d33 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:04.998884 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-38b9f680-ef76-4532-b4d2-3967eca39a4e req-15924cf0-a2c7-4ca1-a743-aba9baa65d33 service nova] Creating event network-vif-plugged:12aa7995-82df-4878-bf95-52ec2ae06c51 for instance eb66512f-3493-4dc5-ab05-79cba34d4a64 on hv-cinder-84488 Jul 12 18:28:05.018524 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-38b9f680-ef76-4532-b4d2-3967eca39a4e req-15924cf0-a2c7-4ca1-a743-aba9baa65d33 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159289 Jul 12 18:28:05.025916 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 156/328] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:28:05.046334 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a2e6b2ac-e2c3-4430-8c79-6d22b1bd270e tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:05.048100 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a2e6b2ac-e2c3-4430-8c79-6d22b1bd270e tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:05.070675 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a2e6b2ac-e2c3-4430-8c79-6d22b1bd270e tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:05.073257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a2e6b2ac-e2c3-4430-8c79-6d22b1bd270e tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:05.074693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a2e6b2ac-e2c3-4430-8c79-6d22b1bd270e tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:05.075711 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a2e6b2ac-e2c3-4430-8c79-6d22b1bd270e tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:05.163729 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:05.420254 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5d944923-3250-4e8c-b79c-65bef2af686a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:05.461759 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5d944923-3250-4e8c-b79c-65bef2af686a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:05.482619 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5d944923-3250-4e8c-b79c-65bef2af686a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:05.485137 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5d944923-3250-4e8c-b79c-65bef2af686a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.629138 Jul 12 18:28:05.492108 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 173/329] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:04 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:05.606002 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a2e6b2ac-e2c3-4430-8c79-6d22b1bd270e tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:05.626231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a2e6b2ac-e2c3-4430-8c79-6d22b1bd270e tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1315 microversion: 2.1 time: 0.597677 Jul 12 18:28:05.645868 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 157/330] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:05 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:06.511264 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-58d6928f-ea34-45dd-8630-b2b4ea65e433 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:06.511941 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-58d6928f-ea34-45dd-8630-b2b4ea65e433 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:06.518744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58d6928f-ea34-45dd-8630-b2b4ea65e433 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:06.519185 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58d6928f-ea34-45dd-8630-b2b4ea65e433 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:06.520038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58d6928f-ea34-45dd-8630-b2b4ea65e433 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:06.520541 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58d6928f-ea34-45dd-8630-b2b4ea65e433 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:06.657314 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c6a9a5b1-e7f7-4e82-a5fa-55c99b21eeac tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:06.658222 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c6a9a5b1-e7f7-4e82-a5fa-55c99b21eeac tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:06.673650 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6a9a5b1-e7f7-4e82-a5fa-55c99b21eeac tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:06.674135 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6a9a5b1-e7f7-4e82-a5fa-55c99b21eeac tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:06.674955 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6a9a5b1-e7f7-4e82-a5fa-55c99b21eeac tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:06.675395 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6a9a5b1-e7f7-4e82-a5fa-55c99b21eeac tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:06.689566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-58d6928f-ea34-45dd-8630-b2b4ea65e433 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:06.699502 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-58d6928f-ea34-45dd-8630-b2b4ea65e433 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:06.701072 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-58d6928f-ea34-45dd-8630-b2b4ea65e433 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:06.702245 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-58d6928f-ea34-45dd-8630-b2b4ea65e433 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.195138 Jul 12 18:28:06.702806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 174/331] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:06 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:06.830989 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c6a9a5b1-e7f7-4e82-a5fa-55c99b21eeac tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:06.839756 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c6a9a5b1-e7f7-4e82-a5fa-55c99b21eeac tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1315 microversion: 2.1 time: 0.186623 Jul 12 18:28:06.840863 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 158/332] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:06 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:07.726313 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7cae6559-e5d6-411a-9a6f-c6c6acb9c86a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:07.733464 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7cae6559-e5d6-411a-9a6f-c6c6acb9c86a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:07.762505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7cae6559-e5d6-411a-9a6f-c6c6acb9c86a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:07.763186 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7cae6559-e5d6-411a-9a6f-c6c6acb9c86a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:07.769566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7cae6559-e5d6-411a-9a6f-c6c6acb9c86a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:07.770569 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7cae6559-e5d6-411a-9a6f-c6c6acb9c86a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:07.819008 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:07.884275 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3734386a-7da5-47c4-8cac-959fc99e8aaf tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:07.894032 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3734386a-7da5-47c4-8cac-959fc99e8aaf tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:07.938172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3734386a-7da5-47c4-8cac-959fc99e8aaf tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:07.938538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3734386a-7da5-47c4-8cac-959fc99e8aaf tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:07.939344 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3734386a-7da5-47c4-8cac-959fc99e8aaf tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:07.939780 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3734386a-7da5-47c4-8cac-959fc99e8aaf tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:08.221047 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7cae6559-e5d6-411a-9a6f-c6c6acb9c86a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:08.245848 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7cae6559-e5d6-411a-9a6f-c6c6acb9c86a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:08.251555 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7cae6559-e5d6-411a-9a6f-c6c6acb9c86a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:08.253826 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7cae6559-e5d6-411a-9a6f-c6c6acb9c86a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.535376 Jul 12 18:28:08.288682 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 175/333] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:07 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:08.322542 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3734386a-7da5-47c4-8cac-959fc99e8aaf tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:08.331058 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3734386a-7da5-47c4-8cac-959fc99e8aaf tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1315 microversion: 2.1 time: 0.468626 Jul 12 18:28:08.336168 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 159/334] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:07 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:09.283178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6b938941-97d5-4a7d-b79c-4be092462051 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:09.284231 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6b938941-97d5-4a7d-b79c-4be092462051 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:09.291649 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6b938941-97d5-4a7d-b79c-4be092462051 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:09.292225 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6b938941-97d5-4a7d-b79c-4be092462051 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:09.293122 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6b938941-97d5-4a7d-b79c-4be092462051 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:09.294040 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6b938941-97d5-4a7d-b79c-4be092462051 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:09.387749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-98fc97ff-f238-4124-94a6-11a6a5e57e4f tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:09.387749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-98fc97ff-f238-4124-94a6-11a6a5e57e4f tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:09.406415 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-98fc97ff-f238-4124-94a6-11a6a5e57e4f tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:09.407198 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-98fc97ff-f238-4124-94a6-11a6a5e57e4f tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:09.408995 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-98fc97ff-f238-4124-94a6-11a6a5e57e4f tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:09.410121 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-98fc97ff-f238-4124-94a6-11a6a5e57e4f tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:09.593781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6b938941-97d5-4a7d-b79c-4be092462051 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:09.613685 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6b938941-97d5-4a7d-b79c-4be092462051 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:09.617715 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6b938941-97d5-4a7d-b79c-4be092462051 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:09.618128 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6b938941-97d5-4a7d-b79c-4be092462051 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.339978 Jul 12 18:28:09.630409 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 176/335] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:09 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:09.719675 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-98fc97ff-f238-4124-94a6-11a6a5e57e4f tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:09.735129 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-98fc97ff-f238-4124-94a6-11a6a5e57e4f tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1464 microversion: 2.1 time: 0.372701 Jul 12 18:28:09.736153 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 160/336] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:09 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1464 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:09.815462 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-49d97128-fd7c-4f35-acf8-e215f4beca68 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:09.816785 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-49d97128-fd7c-4f35-acf8-e215f4beca68 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:09.830986 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-49d97128-fd7c-4f35-acf8-e215f4beca68 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:09.832062 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-49d97128-fd7c-4f35-acf8-e215f4beca68 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:09.834667 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-49d97128-fd7c-4f35-acf8-e215f4beca68 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:09.835697 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-49d97128-fd7c-4f35-acf8-e215f4beca68 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:09.889341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-49d97128-fd7c-4f35-acf8-e215f4beca68 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:28:10.273147 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-49d97128-fd7c-4f35-acf8-e215f4beca68 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "DELETE /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 204 len: 0 microversion: 2.1 time: 0.464911 Jul 12 18:28:10.279139 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 177/337] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:28:09 2022] DELETE /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 18:28:10.288870 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d4ad2e60-d6b3-4a46-b18c-25c11ff86d48 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:10.292786 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d4ad2e60-d6b3-4a46-b18c-25c11ff86d48 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:10.300344 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d4ad2e60-d6b3-4a46-b18c-25c11ff86d48 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:10.301143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d4ad2e60-d6b3-4a46-b18c-25c11ff86d48 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:10.302095 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d4ad2e60-d6b3-4a46-b18c-25c11ff86d48 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:10.302723 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d4ad2e60-d6b3-4a46-b18c-25c11ff86d48 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:10.565822 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d4ad2e60-d6b3-4a46-b18c-25c11ff86d48 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:10.575970 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d4ad2e60-d6b3-4a46-b18c-25c11ff86d48 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1470 microversion: 2.1 time: 0.294309 Jul 12 18:28:10.576597 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 161/338] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:10 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1470 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:10.637355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-35fbf3f2-cc2a-4b88-b059-25b4fc1250b9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:10.638708 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-35fbf3f2-cc2a-4b88-b059-25b4fc1250b9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:10.640914 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:10.647264 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-35fbf3f2-cc2a-4b88-b059-25b4fc1250b9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:10.647704 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-35fbf3f2-cc2a-4b88-b059-25b4fc1250b9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:10.648746 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-35fbf3f2-cc2a-4b88-b059-25b4fc1250b9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:10.655609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-35fbf3f2-cc2a-4b88-b059-25b4fc1250b9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:10.828712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-35fbf3f2-cc2a-4b88-b059-25b4fc1250b9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:10.854033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-35fbf3f2-cc2a-4b88-b059-25b4fc1250b9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:10.862734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-35fbf3f2-cc2a-4b88-b059-25b4fc1250b9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:10.862734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-35fbf3f2-cc2a-4b88-b059-25b4fc1250b9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.223903 Jul 12 18:28:10.862734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 178/339] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:10 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:11.594315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a375ef92-6ba0-4e8e-ba2c-87ef5659acc2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:11.595592 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a375ef92-6ba0-4e8e-ba2c-87ef5659acc2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:11.603510 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a375ef92-6ba0-4e8e-ba2c-87ef5659acc2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:11.603948 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a375ef92-6ba0-4e8e-ba2c-87ef5659acc2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:11.605001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a375ef92-6ba0-4e8e-ba2c-87ef5659acc2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:11.605443 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a375ef92-6ba0-4e8e-ba2c-87ef5659acc2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:11.791501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a375ef92-6ba0-4e8e-ba2c-87ef5659acc2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:11.800188 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a375ef92-6ba0-4e8e-ba2c-87ef5659acc2 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1470 microversion: 2.1 time: 0.209456 Jul 12 18:28:11.810726 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 162/340] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:11 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:11.884737 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ad18fb3d-cae8-43bb-8ef6-dac0fa4cacc7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:11.885660 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ad18fb3d-cae8-43bb-8ef6-dac0fa4cacc7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:11.927924 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ad18fb3d-cae8-43bb-8ef6-dac0fa4cacc7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:11.929462 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ad18fb3d-cae8-43bb-8ef6-dac0fa4cacc7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:11.931531 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ad18fb3d-cae8-43bb-8ef6-dac0fa4cacc7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:11.940510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ad18fb3d-cae8-43bb-8ef6-dac0fa4cacc7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:12.161529 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ad18fb3d-cae8-43bb-8ef6-dac0fa4cacc7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:12.178096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ad18fb3d-cae8-43bb-8ef6-dac0fa4cacc7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:12.179892 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ad18fb3d-cae8-43bb-8ef6-dac0fa4cacc7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:12.181307 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ad18fb3d-cae8-43bb-8ef6-dac0fa4cacc7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1740 microversion: 2.20 time: 0.301909 Jul 12 18:28:12.199236 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 179/341] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:11 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:12.826427 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-50ffdc66-f1b7-47bc-ac19-85dcc95b2abe tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:12.831849 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-50ffdc66-f1b7-47bc-ac19-85dcc95b2abe tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:12.854592 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50ffdc66-f1b7-47bc-ac19-85dcc95b2abe tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:12.860610 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50ffdc66-f1b7-47bc-ac19-85dcc95b2abe tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:12.862384 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50ffdc66-f1b7-47bc-ac19-85dcc95b2abe tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:12.865345 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50ffdc66-f1b7-47bc-ac19-85dcc95b2abe tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:13.111654 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-8160dba1-278e-444f-a5e1-b25b0efc786a req-fb53e926-0d5b-4a18-a758-f8f1efac6ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa637fee-4d51-4d79-aed2-ed75805784bf", "name": "network-vif-unplugged", "status": "completed", "tag": "2f9bf653-860b-4ebb-ba76-4f6b0284e567"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:13.153281 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-8160dba1-278e-444f-a5e1-b25b0efc786a req-fb53e926-0d5b-4a18-a758-f8f1efac6ed6 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:13.154580 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-8160dba1-278e-444f-a5e1-b25b0efc786a req-fb53e926-0d5b-4a18-a758-f8f1efac6ed6 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:13.188776 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-8160dba1-278e-444f-a5e1-b25b0efc786a req-fb53e926-0d5b-4a18-a758-f8f1efac6ed6 service nova] Creating event network-vif-unplugged:2f9bf653-860b-4ebb-ba76-4f6b0284e567 for instance fa637fee-4d51-4d79-aed2-ed75805784bf on hv-cinder-84488 Jul 12 18:28:13.205774 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-8160dba1-278e-444f-a5e1-b25b0efc786a req-fb53e926-0d5b-4a18-a758-f8f1efac6ed6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097679 Jul 12 18:28:13.206985 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 180/342] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:28:13.218480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-db763fd0-f506-44c6-9770-e3bfb1a2eca0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:13.221091 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-50ffdc66-f1b7-47bc-ac19-85dcc95b2abe tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:13.221249 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-db763fd0-f506-44c6-9770-e3bfb1a2eca0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:13.229445 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-50ffdc66-f1b7-47bc-ac19-85dcc95b2abe tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1470 microversion: 2.1 time: 0.415272 Jul 12 18:28:13.230481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 163/343] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:12 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1470 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:13.257789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db763fd0-f506-44c6-9770-e3bfb1a2eca0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:13.258586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db763fd0-f506-44c6-9770-e3bfb1a2eca0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:13.259968 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db763fd0-f506-44c6-9770-e3bfb1a2eca0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:13.261607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db763fd0-f506-44c6-9770-e3bfb1a2eca0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:13.668853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-db763fd0-f506-44c6-9770-e3bfb1a2eca0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:13.685371 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-db763fd0-f506-44c6-9770-e3bfb1a2eca0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:13.688566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-db763fd0-f506-44c6-9770-e3bfb1a2eca0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:13.690725 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-db763fd0-f506-44c6-9770-e3bfb1a2eca0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1722 microversion: 2.20 time: 0.481711 Jul 12 18:28:13.691590 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 181/344] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:13 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1722 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:14.259205 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c77d01d2-833a-479a-aab2-a43b98a3c213 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:14.260588 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c77d01d2-833a-479a-aab2-a43b98a3c213 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:14.269130 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c77d01d2-833a-479a-aab2-a43b98a3c213 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:14.270457 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c77d01d2-833a-479a-aab2-a43b98a3c213 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:14.271695 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c77d01d2-833a-479a-aab2-a43b98a3c213 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:14.272385 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c77d01d2-833a-479a-aab2-a43b98a3c213 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:14.465912 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c77d01d2-833a-479a-aab2-a43b98a3c213 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:14.477900 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c77d01d2-833a-479a-aab2-a43b98a3c213 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1470 microversion: 2.1 time: 0.222934 Jul 12 18:28:14.479289 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 164/345] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:14 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1470 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:14.708966 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-feaee98e-b90c-43a1-af81-7974ca5494b4 req-c13af5e3-b627-4f4c-bd1b-4f763239d2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb66512f-3493-4dc5-ab05-79cba34d4a64", "name": "network-vif-deleted", "tag": "12aa7995-82df-4878-bf95-52ec2ae06c51"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:14.718702 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2020132a-045a-4292-9849-4bd7c456de04 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:14.719028 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-feaee98e-b90c-43a1-af81-7974ca5494b4 req-c13af5e3-b627-4f4c-bd1b-4f763239d2c5 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:14.719237 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-feaee98e-b90c-43a1-af81-7974ca5494b4 req-c13af5e3-b627-4f4c-bd1b-4f763239d2c5 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:14.720790 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2020132a-045a-4292-9849-4bd7c456de04 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:14.737161 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2020132a-045a-4292-9849-4bd7c456de04 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:14.746441 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-feaee98e-b90c-43a1-af81-7974ca5494b4 req-c13af5e3-b627-4f4c-bd1b-4f763239d2c5 service nova] Creating event network-vif-deleted:12aa7995-82df-4878-bf95-52ec2ae06c51 for instance eb66512f-3493-4dc5-ab05-79cba34d4a64 on hv-cinder-84488 Jul 12 18:28:14.750594 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2020132a-045a-4292-9849-4bd7c456de04 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:14.752102 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2020132a-045a-4292-9849-4bd7c456de04 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:14.773480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-feaee98e-b90c-43a1-af81-7974ca5494b4 req-c13af5e3-b627-4f4c-bd1b-4f763239d2c5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068290 Jul 12 18:28:14.777288 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2020132a-045a-4292-9849-4bd7c456de04 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:14.783336 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 182/346] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:28:15.000428 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2020132a-045a-4292-9849-4bd7c456de04 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:15.000428 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2020132a-045a-4292-9849-4bd7c456de04 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:15.000866 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2020132a-045a-4292-9849-4bd7c456de04 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:15.000866 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2020132a-045a-4292-9849-4bd7c456de04 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1722 microversion: 2.20 time: 0.282595 Jul 12 18:28:15.000866 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 165/347] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:14 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:15.504842 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2bb92fea-dc3f-4114-b8bf-c2847e89e5ae tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:15.505536 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2bb92fea-dc3f-4114-b8bf-c2847e89e5ae tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:15.512507 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2bb92fea-dc3f-4114-b8bf-c2847e89e5ae tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:15.513055 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2bb92fea-dc3f-4114-b8bf-c2847e89e5ae tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:15.513945 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2bb92fea-dc3f-4114-b8bf-c2847e89e5ae tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:15.514383 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2bb92fea-dc3f-4114-b8bf-c2847e89e5ae tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:15.608130 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2bb92fea-dc3f-4114-b8bf-c2847e89e5ae tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:15.617187 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2bb92fea-dc3f-4114-b8bf-c2847e89e5ae tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1428 microversion: 2.1 time: 0.117125 Jul 12 18:28:15.625205 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 183/348] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:15 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:16.014538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f0c126ef-9763-4d51-b70d-f77de6168aeb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:16.016248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f0c126ef-9763-4d51-b70d-f77de6168aeb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:16.025265 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0c126ef-9763-4d51-b70d-f77de6168aeb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:16.025757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0c126ef-9763-4d51-b70d-f77de6168aeb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:16.027108 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0c126ef-9763-4d51-b70d-f77de6168aeb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:16.027108 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0c126ef-9763-4d51-b70d-f77de6168aeb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:16.191051 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f0c126ef-9763-4d51-b70d-f77de6168aeb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:16.206458 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f0c126ef-9763-4d51-b70d-f77de6168aeb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:16.209393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f0c126ef-9763-4d51-b70d-f77de6168aeb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:16.211444 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f0c126ef-9763-4d51-b70d-f77de6168aeb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1722 microversion: 2.20 time: 0.201842 Jul 12 18:28:16.212515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 166/349] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:16 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:16.584671 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2ce6d4dd-345e-4d4f-8059-509c32cd7d11 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Action: 'create', calling method: .version_select at 0x7f1bb0d6f550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-841300904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOj6m1VuEOwpUBBsz2FqlrbeBUZsOsC7xjONEsBOcrlzV/A8dSE7BUf4NF4DKmkorddrngR3VeF2Sfo+ixsgYBEgmtpgHu72tjc9AQ1+74Za7GUKa428d9abygXQq//1Q=="}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:16.617668 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-2ce6d4dd-345e-4d4f-8059-509c32cd7d11 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Getting quotas for project c9b591880e9441acac9ddf006a5f9959. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:28:16.621638 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-2ce6d4dd-345e-4d4f-8059-509c32cd7d11 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Getting quotas for user 0e36c7fd357044ccbb59bddd12b61149 and project c9b591880e9441acac9ddf006a5f9959. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:28:16.643126 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4d22dd84-3883-4409-a54f-5db232a5edc5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:16.643753 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4d22dd84-3883-4409-a54f-5db232a5edc5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:16.664281 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d22dd84-3883-4409-a54f-5db232a5edc5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:16.665101 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d22dd84-3883-4409-a54f-5db232a5edc5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:16.666569 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d22dd84-3883-4409-a54f-5db232a5edc5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:16.667308 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d22dd84-3883-4409-a54f-5db232a5edc5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:16.772697 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2ce6d4dd-345e-4d4f-8059-509c32cd7d11 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.192592 Jul 12 18:28:16.773903 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 184/350] 10.222.0.47 () {60 vars in 1158 bytes} [Tue Jul 12 18:28:16 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:28:16.793094 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4d22dd84-3883-4409-a54f-5db232a5edc5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:16.806458 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4d22dd84-3883-4409-a54f-5db232a5edc5 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1300 microversion: 2.1 time: 0.171025 Jul 12 18:28:16.817414 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 167/351] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:16 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1300 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:16.904486 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1224192030", "imageRef": "ad77c162-4374-42a4-a433-20c0a293fdc7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-841300904", "networks": [{"uuid": "89923339-f041-4618-b759-1b647ba41f00"}]}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:16.961259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] validate_networks() for [('89923339-f041-4618-b759-1b647ba41f00', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:28:17.232439 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e3bed33e-8f86-4144-b333-e8779fc4fa03 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:17.233837 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e3bed33e-8f86-4144-b333-e8779fc4fa03 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:17.246547 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e3bed33e-8f86-4144-b333-e8779fc4fa03 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:17.247673 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e3bed33e-8f86-4144-b333-e8779fc4fa03 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:17.249583 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e3bed33e-8f86-4144-b333-e8779fc4fa03 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:17.250672 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e3bed33e-8f86-4144-b333-e8779fc4fa03 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:17.403573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:28:17.404023 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:28:17.404549 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:28:17.404957 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:28:17.405370 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:28:17.417790 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:17.418562 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:17.419963 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:17.420717 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:17.449484 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Getting quotas for project c9b591880e9441acac9ddf006a5f9959. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:28:17.458452 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Getting quotas for user 0e36c7fd357044ccbb59bddd12b61149 and project c9b591880e9441acac9ddf006a5f9959. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:28:17.472578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e3bed33e-8f86-4144-b333-e8779fc4fa03 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:17.479451 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:28:17.482486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e3bed33e-8f86-4144-b333-e8779fc4fa03 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:17.483926 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ad77c162-4374-42a4-a433-20c0a293fdc7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:28:17.484266 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e3bed33e-8f86-4144-b333-e8779fc4fa03 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:17.485478 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e3bed33e-8f86-4144-b333-e8779fc4fa03 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1722 microversion: 2.20 time: 0.258277 Jul 12 18:28:17.486056 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 168/352] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:17 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:17.626381 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d13bcc8e-291f-4008-9d9a-baa250c93639 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725516 Jul 12 18:28:17.627568 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 185/353] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:28:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:28:17.644526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ee4f350d-a179-4a54-8aac-366649b8ad43 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:17.649518 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ee4f350d-a179-4a54-8aac-366649b8ad43 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:17.772414 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ee4f350d-a179-4a54-8aac-366649b8ad43 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:17.786472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ee4f350d-a179-4a54-8aac-366649b8ad43 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1258 microversion: 2.1 time: 0.150028 Jul 12 18:28:17.787976 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 169/354] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:17 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:17.835346 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-97c03c56-1c78-4358-8c09-31cf1f51bf4d tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:17.836083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-97c03c56-1c78-4358-8c09-31cf1f51bf4d tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:17.843645 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97c03c56-1c78-4358-8c09-31cf1f51bf4d tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:17.844091 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97c03c56-1c78-4358-8c09-31cf1f51bf4d tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:17.844921 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97c03c56-1c78-4358-8c09-31cf1f51bf4d tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:17.845365 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97c03c56-1c78-4358-8c09-31cf1f51bf4d tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:17.881195 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97c03c56-1c78-4358-8c09-31cf1f51bf4d tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:17.881646 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97c03c56-1c78-4358-8c09-31cf1f51bf4d tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:17.882327 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-97c03c56-1c78-4358-8c09-31cf1f51bf4d tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lazy-loading 'fault' on Instance uuid eb66512f-3493-4dc5-ab05-79cba34d4a64 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:28:17.932024 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-97c03c56-1c78-4358-8c09-31cf1f51bf4d tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:17.939945 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-97c03c56-1c78-4358-8c09-31cf1f51bf4d tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1305 microversion: 2.1 time: 0.110741 Jul 12 18:28:17.941891 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 186/355] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:17 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:18.518025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-aae06c32-0873-4aaf-9b91-1554b69e8364 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:18.519063 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-aae06c32-0873-4aaf-9b91-1554b69e8364 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:18.530916 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aae06c32-0873-4aaf-9b91-1554b69e8364 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:18.531785 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aae06c32-0873-4aaf-9b91-1554b69e8364 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:18.532713 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aae06c32-0873-4aaf-9b91-1554b69e8364 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:18.533285 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aae06c32-0873-4aaf-9b91-1554b69e8364 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:18.706033 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-aae06c32-0873-4aaf-9b91-1554b69e8364 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:18.717330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-aae06c32-0873-4aaf-9b91-1554b69e8364 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:18.719475 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-aae06c32-0873-4aaf-9b91-1554b69e8364 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:18.721013 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-aae06c32-0873-4aaf-9b91-1554b69e8364 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1722 microversion: 2.20 time: 0.209878 Jul 12 18:28:18.721698 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 170/356] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:18 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:18.805553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-86c223cf-1155-4e06-a2e0-cab0f7f5417a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:18.806268 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-86c223cf-1155-4e06-a2e0-cab0f7f5417a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:18.899714 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-86c223cf-1155-4e06-a2e0-cab0f7f5417a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:18.908463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-86c223cf-1155-4e06-a2e0-cab0f7f5417a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1258 microversion: 2.1 time: 0.107410 Jul 12 18:28:18.913242 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 187/357] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:18 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1258 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:18.962050 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6d7a4875-8be6-45a4-81af-253524f70611 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:18.964417 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6d7a4875-8be6-45a4-81af-253524f70611 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:18.980144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d7a4875-8be6-45a4-81af-253524f70611 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:18.981358 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d7a4875-8be6-45a4-81af-253524f70611 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:18.983305 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d7a4875-8be6-45a4-81af-253524f70611 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:18.985285 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d7a4875-8be6-45a4-81af-253524f70611 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:19.058902 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d7a4875-8be6-45a4-81af-253524f70611 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:19.059356 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d7a4875-8be6-45a4-81af-253524f70611 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:19.060074 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-6d7a4875-8be6-45a4-81af-253524f70611 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lazy-loading 'fault' on Instance uuid eb66512f-3493-4dc5-ab05-79cba34d4a64 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:28:19.144454 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6d7a4875-8be6-45a4-81af-253524f70611 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6767e4eeaf094d61a75469e9c7d66eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e838bf49cff94199ac354e9f42d42af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:19.157748 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6d7a4875-8be6-45a4-81af-253524f70611 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 200 len: 1305 microversion: 2.1 time: 0.203401 Jul 12 18:28:19.158565 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 171/358] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:18 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 1305 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:19.750734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5b90a4e4-33e2-4511-a8db-1a269986978c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:19.751906 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5b90a4e4-33e2-4511-a8db-1a269986978c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:19.764193 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b90a4e4-33e2-4511-a8db-1a269986978c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:19.765741 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b90a4e4-33e2-4511-a8db-1a269986978c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:19.767460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b90a4e4-33e2-4511-a8db-1a269986978c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:19.768081 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b90a4e4-33e2-4511-a8db-1a269986978c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:19.934535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-25d7b596-b821-4884-b3d1-976119e7a4da tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:19.935212 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-25d7b596-b821-4884-b3d1-976119e7a4da tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:19.949798 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25d7b596-b821-4884-b3d1-976119e7a4da tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:19.951094 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25d7b596-b821-4884-b3d1-976119e7a4da tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:19.952682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25d7b596-b821-4884-b3d1-976119e7a4da tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:19.954250 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25d7b596-b821-4884-b3d1-976119e7a4da tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:19.972502 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5b90a4e4-33e2-4511-a8db-1a269986978c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:19.983216 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5b90a4e4-33e2-4511-a8db-1a269986978c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:19.984923 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5b90a4e4-33e2-4511-a8db-1a269986978c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:19.986134 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5b90a4e4-33e2-4511-a8db-1a269986978c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1725 microversion: 2.20 time: 0.239844 Jul 12 18:28:19.987183 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 188/359] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:19 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:20.015844 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2c57076a-b16f-482c-929b-cef9981ae49a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ecc210c-1368-4b8c-a6f5-63d0bb0333fc"}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:20.017424 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2c57076a-b16f-482c-929b-cef9981ae49a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:20.026105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2c57076a-b16f-482c-929b-cef9981ae49a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:20.026932 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2c57076a-b16f-482c-929b-cef9981ae49a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:20.036399 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2c57076a-b16f-482c-929b-cef9981ae49a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:20.036399 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2c57076a-b16f-482c-929b-cef9981ae49a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:20.073368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-25d7b596-b821-4884-b3d1-976119e7a4da tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:20.085989 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-25d7b596-b821-4884-b3d1-976119e7a4da tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1310 microversion: 2.1 time: 0.161009 Jul 12 18:28:20.087336 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 172/360] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:19 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1310 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:20.182891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-aca6cb1f-d663-41dd-a3d5-b2cc0f438c84 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:20.183505 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-aca6cb1f-d663-41dd-a3d5-b2cc0f438c84 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] [instance: eb66512f-3493-4dc5-ab05-79cba34d4a64] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:20.190400 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aca6cb1f-d663-41dd-a3d5-b2cc0f438c84 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:20.190848 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aca6cb1f-d663-41dd-a3d5-b2cc0f438c84 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:20.191663 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aca6cb1f-d663-41dd-a3d5-b2cc0f438c84 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:20.192094 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aca6cb1f-d663-41dd-a3d5-b2cc0f438c84 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:20.215693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-aca6cb1f-d663-41dd-a3d5-b2cc0f438c84 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] HTTP exception thrown: Instance eb66512f-3493-4dc5-ab05-79cba34d4a64 could not be found. Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-aca6cb1f-d663-41dd-a3d5-b2cc0f438c84 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Request method failure captured: Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 HTTP/1.1 Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb0YprMHUjmUZWDC5rdFjYYd5DqwOVZua-czttqpaX43ZTSOvdpAW55aK8vJ2i3pr-j4H_2P_mmO-THAO5ivJZqAy3aZQ41we2ZQvNpn4O-IL01ztxwmzaOabrqRiztkUggihtxxcNHMxfAA5rUOaZiWIeBzVFH9Z7YOrtR98MlJTRk Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: e838bf49cff94199ac354e9f42d42af2 Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesNegativeTest-164286168 Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:28:20.217653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e838bf49cff94199ac354e9f42d42af2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/e838bf49cff94199ac354e9f42d42af2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_e838bf49cff94199ac354e9f42d42af2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/e838bf49cff94199ac354e9f42d42af2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesNegativeTest-164286168 Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: e838bf49cff94199ac354e9f42d42af2 Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesNegativeTest-164286168 Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesNegativeTest-164286168-project Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 6767e4eeaf094d61a75469e9c7d66eac Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesNegativeTest-164286168-project Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance eb66512f-3493-4dc5-ab05-79cba34d4a64 could not be found. Jul 12 18:28:20.220734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'eb66512f-3493-4dc5-ab05-79cba34d4a64'} Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb66512f-3493-4dc5-ab05-79cba34d4a64 could not be found. Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:28:20.222185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb66512f-3493-4dc5-ab05-79cba34d4a64 could not be found. Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb66512f-3493-4dc5-ab05-79cba34d4a64 could not be found. Jul 12 18:28:20.225669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:28:20.227622 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-aca6cb1f-d663-41dd-a3d5-b2cc0f438c84 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] Returning 404 to user: Instance eb66512f-3493-4dc5-ab05-79cba34d4a64 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:28:20.227622 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-aca6cb1f-d663-41dd-a3d5-b2cc0f438c84 tempest-VolumesNegativeTest-164286168 tempest-VolumesNegativeTest-164286168-project] 10.222.0.47 "GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64" status: 404 len: 111 microversion: 2.1 time: 0.041297 Jul 12 18:28:20.227622 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 173/361] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:20 2022] GET /compute/v2.1/servers/eb66512f-3493-4dc5-ab05-79cba34d4a64 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 18:28:21.108645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-566df02f-7002-485e-8d58-ad8b797e8004 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:21.109763 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-566df02f-7002-485e-8d58-ad8b797e8004 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:21.118452 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-566df02f-7002-485e-8d58-ad8b797e8004 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:21.118958 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-566df02f-7002-485e-8d58-ad8b797e8004 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:21.119863 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-566df02f-7002-485e-8d58-ad8b797e8004 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:21.120370 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-566df02f-7002-485e-8d58-ad8b797e8004 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:21.240007 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-566df02f-7002-485e-8d58-ad8b797e8004 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:21.253937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-566df02f-7002-485e-8d58-ad8b797e8004 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1318 microversion: 2.1 time: 0.150031 Jul 12 18:28:21.255500 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 174/362] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:21 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:21.459240 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2c57076a-b16f-482c-929b-cef9981ae49a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "POST /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.447773 Jul 12 18:28:21.462335 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 189/363] 10.222.0.47 () {62 vars in 1363 bytes} [Tue Jul 12 18:28:20 2022] POST /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments => generated 188 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 18:28:21.662639 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-413d7223-9ccf-4de1-8ab4-c99aa4e3535e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:21.663648 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-413d7223-9ccf-4de1-8ab4-c99aa4e3535e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:21.709698 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-413d7223-9ccf-4de1-8ab4-c99aa4e3535e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:21.710800 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-413d7223-9ccf-4de1-8ab4-c99aa4e3535e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:21.712453 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-413d7223-9ccf-4de1-8ab4-c99aa4e3535e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:21.715779 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-413d7223-9ccf-4de1-8ab4-c99aa4e3535e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:21.752386 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:22.136064 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-413d7223-9ccf-4de1-8ab4-c99aa4e3535e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "POST /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/action" status: 202 len: 0 microversion: 2.20 time: 0.480151 Jul 12 18:28:22.147199 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 175/364] 10.222.0.47 () {62 vars in 1318 bytes} [Tue Jul 12 18:28:21 2022] POST /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:28:22.162432 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5d038215-8c2d-4297-87e6-800dd56eac93 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:22.163580 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5d038215-8c2d-4297-87e6-800dd56eac93 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:22.201010 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d038215-8c2d-4297-87e6-800dd56eac93 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:22.204105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d038215-8c2d-4297-87e6-800dd56eac93 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:22.206763 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d038215-8c2d-4297-87e6-800dd56eac93 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:22.208659 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d038215-8c2d-4297-87e6-800dd56eac93 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:22.283685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8704733c-0796-4363-a305-57fbc509f4a2 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:22.284439 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8704733c-0796-4363-a305-57fbc509f4a2 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:22.312275 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8704733c-0796-4363-a305-57fbc509f4a2 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:22.314453 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8704733c-0796-4363-a305-57fbc509f4a2 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:22.315481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8704733c-0796-4363-a305-57fbc509f4a2 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:22.319441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8704733c-0796-4363-a305-57fbc509f4a2 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:22.429513 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5d038215-8c2d-4297-87e6-800dd56eac93 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:22.439241 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5d038215-8c2d-4297-87e6-800dd56eac93 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:22.455104 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5d038215-8c2d-4297-87e6-800dd56eac93 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:22.456668 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5d038215-8c2d-4297-87e6-800dd56eac93 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1751 microversion: 2.20 time: 0.302678 Jul 12 18:28:22.458710 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 190/365] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:22 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1751 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:22.503674 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8704733c-0796-4363-a305-57fbc509f4a2 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:22.523091 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8704733c-0796-4363-a305-57fbc509f4a2 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1316 microversion: 2.1 time: 0.243068 Jul 12 18:28:22.524831 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 176/366] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:22 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:23.488194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-730ed08e-5216-41ed-bc99-ac72e9894ae8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:23.490294 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-730ed08e-5216-41ed-bc99-ac72e9894ae8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:23.497824 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-730ed08e-5216-41ed-bc99-ac72e9894ae8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:23.498779 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-730ed08e-5216-41ed-bc99-ac72e9894ae8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:23.500125 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-730ed08e-5216-41ed-bc99-ac72e9894ae8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:23.500801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-730ed08e-5216-41ed-bc99-ac72e9894ae8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:23.528391 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:23.550495 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-718d89aa-cbf9-43bc-adf0-85094fde421c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:23.552741 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-718d89aa-cbf9-43bc-adf0-85094fde421c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:23.590984 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-718d89aa-cbf9-43bc-adf0-85094fde421c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:23.591430 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-718d89aa-cbf9-43bc-adf0-85094fde421c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:23.592248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-718d89aa-cbf9-43bc-adf0-85094fde421c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:23.592728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-718d89aa-cbf9-43bc-adf0-85094fde421c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:23.794582 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-730ed08e-5216-41ed-bc99-ac72e9894ae8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:23.807546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-730ed08e-5216-41ed-bc99-ac72e9894ae8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:23.810287 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-730ed08e-5216-41ed-bc99-ac72e9894ae8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:23.811911 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-730ed08e-5216-41ed-bc99-ac72e9894ae8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1751 microversion: 2.20 time: 0.327971 Jul 12 18:28:23.814555 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 191/367] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:23 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1751 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:24.056621 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-718d89aa-cbf9-43bc-adf0-85094fde421c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:24.069344 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-718d89aa-cbf9-43bc-adf0-85094fde421c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.523211 Jul 12 18:28:24.070296 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 177/368] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:23 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:24.838074 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ae446597-e030-4310-9ce4-8a88475340d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:24.839961 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ae446597-e030-4310-9ce4-8a88475340d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:24.862937 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ae446597-e030-4310-9ce4-8a88475340d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:24.865874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ae446597-e030-4310-9ce4-8a88475340d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:24.888224 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ae446597-e030-4310-9ce4-8a88475340d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:24.888994 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ae446597-e030-4310-9ce4-8a88475340d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:25.088286 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d15274e4-7683-4960-82de-117d4a61525a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:25.089472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d15274e4-7683-4960-82de-117d4a61525a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:25.103911 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d15274e4-7683-4960-82de-117d4a61525a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:25.106222 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d15274e4-7683-4960-82de-117d4a61525a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:25.108709 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d15274e4-7683-4960-82de-117d4a61525a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:25.111303 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d15274e4-7683-4960-82de-117d4a61525a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:25.389733 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ae446597-e030-4310-9ce4-8a88475340d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:25.427917 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ae446597-e030-4310-9ce4-8a88475340d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:25.436834 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ae446597-e030-4310-9ce4-8a88475340d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:25.446773 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ae446597-e030-4310-9ce4-8a88475340d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1751 microversion: 2.20 time: 0.615497 Jul 12 18:28:25.452576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 192/369] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:24 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1751 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:25.497933 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-a97e1568-871d-4031-9e67-093f9a2a5c6d req-1834bc38-ef00-4611-ab19-14bc7264b6ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c546fb53-6e12-426c-99a6-e6264514203d", "tag": "6becd9b8-f6f0-4c1e-8ce2-67eb379069f7"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:25.501841 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d15274e4-7683-4960-82de-117d4a61525a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:25.517810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d15274e4-7683-4960-82de-117d4a61525a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.432898 Jul 12 18:28:25.518108 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 178/370] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:25 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:25.544238 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-a97e1568-871d-4031-9e67-093f9a2a5c6d req-1834bc38-ef00-4611-ab19-14bc7264b6ab service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:25.544238 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-a97e1568-871d-4031-9e67-093f9a2a5c6d req-1834bc38-ef00-4611-ab19-14bc7264b6ab service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:25.571996 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-a97e1568-871d-4031-9e67-093f9a2a5c6d req-1834bc38-ef00-4611-ab19-14bc7264b6ab service nova] Creating event network-changed:6becd9b8-f6f0-4c1e-8ce2-67eb379069f7 for instance c546fb53-6e12-426c-99a6-e6264514203d on hv-cinder-84488 Jul 12 18:28:25.585780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-a97e1568-871d-4031-9e67-093f9a2a5c6d req-1834bc38-ef00-4611-ab19-14bc7264b6ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124975 Jul 12 18:28:25.587333 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 193/371] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:28:26.494062 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b9cd15be-5c29-4f7b-949b-4614a802ff1b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:26.495579 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b9cd15be-5c29-4f7b-949b-4614a802ff1b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:26.526585 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9cd15be-5c29-4f7b-949b-4614a802ff1b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:26.527528 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9cd15be-5c29-4f7b-949b-4614a802ff1b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:26.529012 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9cd15be-5c29-4f7b-949b-4614a802ff1b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:26.529841 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9cd15be-5c29-4f7b-949b-4614a802ff1b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:26.543217 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bc29b4b9-7eb8-4db9-b4a4-7ffcf55b254d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:26.544095 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-bc29b4b9-7eb8-4db9-b4a4-7ffcf55b254d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:26.551665 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc29b4b9-7eb8-4db9-b4a4-7ffcf55b254d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:26.552218 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc29b4b9-7eb8-4db9-b4a4-7ffcf55b254d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:26.553079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc29b4b9-7eb8-4db9-b4a4-7ffcf55b254d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:26.553522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bc29b4b9-7eb8-4db9-b4a4-7ffcf55b254d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:26.809549 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b9cd15be-5c29-4f7b-949b-4614a802ff1b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:26.822665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b9cd15be-5c29-4f7b-949b-4614a802ff1b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:26.825832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b9cd15be-5c29-4f7b-949b-4614a802ff1b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:26.827131 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b9cd15be-5c29-4f7b-949b-4614a802ff1b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1751 microversion: 2.20 time: 0.340997 Jul 12 18:28:26.828019 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 179/372] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:26 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1751 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:26.946684 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-bc29b4b9-7eb8-4db9-b4a4-7ffcf55b254d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:26.956211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bc29b4b9-7eb8-4db9-b4a4-7ffcf55b254d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.417505 Jul 12 18:28:26.966897 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 194/373] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:26 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:27.625970 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-40073cf6-130a-4e67-b741-a1c6cf512e7e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b167d5c7-cabd-4576-94f0-a6d4425fd038"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:27.632982 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-40073cf6-130a-4e67-b741-a1c6cf512e7e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:27.653937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=64 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:27.660891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-40073cf6-130a-4e67-b741-a1c6cf512e7e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:27.667047 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-40073cf6-130a-4e67-b741-a1c6cf512e7e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:27.668816 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-40073cf6-130a-4e67-b741-a1c6cf512e7e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:27.669813 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-40073cf6-130a-4e67-b741-a1c6cf512e7e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:27.779814 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:27.873202 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bf7a1839-377f-4e51-8db1-2a1f69636ba7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:27.873963 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-bf7a1839-377f-4e51-8db1-2a1f69636ba7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:27.878278 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:27.899026 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bf7a1839-377f-4e51-8db1-2a1f69636ba7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:27.899648 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bf7a1839-377f-4e51-8db1-2a1f69636ba7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:27.900696 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bf7a1839-377f-4e51-8db1-2a1f69636ba7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:27.904588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bf7a1839-377f-4e51-8db1-2a1f69636ba7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:28.279858 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-bf7a1839-377f-4e51-8db1-2a1f69636ba7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:28.298099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-bf7a1839-377f-4e51-8db1-2a1f69636ba7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:28.302500 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-bf7a1839-377f-4e51-8db1-2a1f69636ba7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:28.305761 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bf7a1839-377f-4e51-8db1-2a1f69636ba7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1751 microversion: 2.20 time: 0.453213 Jul 12 18:28:28.307656 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 195/374] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:27 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1751 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:28.320408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6240d66c-7b7f-46f7-b326-6a8bc78d545b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:28.321848 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6240d66c-7b7f-46f7-b326-6a8bc78d545b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:28.334113 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6240d66c-7b7f-46f7-b326-6a8bc78d545b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:28.335330 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6240d66c-7b7f-46f7-b326-6a8bc78d545b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:28.336776 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6240d66c-7b7f-46f7-b326-6a8bc78d545b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:28.337782 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6240d66c-7b7f-46f7-b326-6a8bc78d545b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:28.590268 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6240d66c-7b7f-46f7-b326-6a8bc78d545b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:28.607629 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6240d66c-7b7f-46f7-b326-6a8bc78d545b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.296634 Jul 12 18:28:28.609336 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 196/375] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:28 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:29.336913 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6bff76de-93fd-4fe2-a2bc-9fdc00f8d832 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:29.338276 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6bff76de-93fd-4fe2-a2bc-9fdc00f8d832 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:29.348269 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=12 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:29.351292 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6bff76de-93fd-4fe2-a2bc-9fdc00f8d832 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:29.352028 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6bff76de-93fd-4fe2-a2bc-9fdc00f8d832 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:29.362863 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6bff76de-93fd-4fe2-a2bc-9fdc00f8d832 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:29.363331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6bff76de-93fd-4fe2-a2bc-9fdc00f8d832 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:29.632960 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6bff76de-93fd-4fe2-a2bc-9fdc00f8d832 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:29.662723 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6bff76de-93fd-4fe2-a2bc-9fdc00f8d832 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:29.662723 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6bff76de-93fd-4fe2-a2bc-9fdc00f8d832 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:29.662723 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6bff76de-93fd-4fe2-a2bc-9fdc00f8d832 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1751 microversion: 2.20 time: 0.332831 Jul 12 18:28:29.667986 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 197/376] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:29 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1751 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:29.681132 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5551e286-9015-45c2-948f-ddb05b0da3a3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:29.681982 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5551e286-9015-45c2-948f-ddb05b0da3a3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:29.693887 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5551e286-9015-45c2-948f-ddb05b0da3a3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:29.694687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5551e286-9015-45c2-948f-ddb05b0da3a3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:29.695711 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5551e286-9015-45c2-948f-ddb05b0da3a3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:29.697074 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5551e286-9015-45c2-948f-ddb05b0da3a3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:29.984198 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5551e286-9015-45c2-948f-ddb05b0da3a3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:30.016445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5551e286-9015-45c2-948f-ddb05b0da3a3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.348137 Jul 12 18:28:30.017573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 198/377] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:29 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:30.695356 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1c010f9d-2185-4c5e-b655-0da4ecd1d8b0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:30.697946 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1c010f9d-2185-4c5e-b655-0da4ecd1d8b0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:30.710271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1c010f9d-2185-4c5e-b655-0da4ecd1d8b0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:30.713318 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1c010f9d-2185-4c5e-b655-0da4ecd1d8b0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:30.713318 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1c010f9d-2185-4c5e-b655-0da4ecd1d8b0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:30.713318 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1c010f9d-2185-4c5e-b655-0da4ecd1d8b0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:30.972659 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1c010f9d-2185-4c5e-b655-0da4ecd1d8b0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:30.987465 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1c010f9d-2185-4c5e-b655-0da4ecd1d8b0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:30.998496 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1c010f9d-2185-4c5e-b655-0da4ecd1d8b0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:30.998496 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1c010f9d-2185-4c5e-b655-0da4ecd1d8b0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1751 microversion: 2.20 time: 0.303811 Jul 12 18:28:31.005374 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 199/378] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:30 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1751 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:31.067389 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-14567682-554a-404b-8f3b-30f4025cb0a8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:31.068922 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-14567682-554a-404b-8f3b-30f4025cb0a8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:31.082428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-14567682-554a-404b-8f3b-30f4025cb0a8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:31.085394 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-14567682-554a-404b-8f3b-30f4025cb0a8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:31.088116 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-14567682-554a-404b-8f3b-30f4025cb0a8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:31.088889 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-14567682-554a-404b-8f3b-30f4025cb0a8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:31.359517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-14567682-554a-404b-8f3b-30f4025cb0a8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:31.385060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-14567682-554a-404b-8f3b-30f4025cb0a8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.331486 Jul 12 18:28:31.386363 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 200/379] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:31 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:32.015338 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5b6043ae-0715-4403-98f1-beb81cf39473 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:32.018249 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5b6043ae-0715-4403-98f1-beb81cf39473 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:32.030286 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b6043ae-0715-4403-98f1-beb81cf39473 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:32.041216 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b6043ae-0715-4403-98f1-beb81cf39473 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:32.043408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b6043ae-0715-4403-98f1-beb81cf39473 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:32.050745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5b6043ae-0715-4403-98f1-beb81cf39473 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:32.399423 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5b6043ae-0715-4403-98f1-beb81cf39473 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:32.407382 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5b6043ae-0715-4403-98f1-beb81cf39473 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:32.409503 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5b6043ae-0715-4403-98f1-beb81cf39473 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:32.411713 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5b6043ae-0715-4403-98f1-beb81cf39473 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1751 microversion: 2.20 time: 0.403988 Jul 12 18:28:32.412845 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 201/380] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:32 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1751 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:32.422031 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f613cf10-0535-4983-af4a-7998db39dfc3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:32.423772 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f613cf10-0535-4983-af4a-7998db39dfc3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:32.431109 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f613cf10-0535-4983-af4a-7998db39dfc3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:32.431880 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f613cf10-0535-4983-af4a-7998db39dfc3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:32.432973 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f613cf10-0535-4983-af4a-7998db39dfc3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:32.433603 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f613cf10-0535-4983-af4a-7998db39dfc3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:32.662113 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f613cf10-0535-4983-af4a-7998db39dfc3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:32.693658 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f613cf10-0535-4983-af4a-7998db39dfc3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.277902 Jul 12 18:28:32.694748 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 202/381] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:32 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:33.436534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-05272a26-6a74-4a25-b0c9-19e5266ebc6e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:33.437816 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-05272a26-6a74-4a25-b0c9-19e5266ebc6e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:33.448996 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05272a26-6a74-4a25-b0c9-19e5266ebc6e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:33.449651 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05272a26-6a74-4a25-b0c9-19e5266ebc6e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:33.450928 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05272a26-6a74-4a25-b0c9-19e5266ebc6e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:33.451518 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05272a26-6a74-4a25-b0c9-19e5266ebc6e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:33.725790 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-05272a26-6a74-4a25-b0c9-19e5266ebc6e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:33.743210 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-05272a26-6a74-4a25-b0c9-19e5266ebc6e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:33.746217 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-05272a26-6a74-4a25-b0c9-19e5266ebc6e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:33.754429 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-05272a26-6a74-4a25-b0c9-19e5266ebc6e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1751 microversion: 2.20 time: 0.325186 Jul 12 18:28:33.756422 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 203/382] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:33 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1751 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:33.784115 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5bb73184-f51a-4fa3-9049-81bc0ab017e8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:33.785566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5bb73184-f51a-4fa3-9049-81bc0ab017e8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:33.797846 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5bb73184-f51a-4fa3-9049-81bc0ab017e8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:33.798798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5bb73184-f51a-4fa3-9049-81bc0ab017e8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:33.799987 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5bb73184-f51a-4fa3-9049-81bc0ab017e8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:33.800653 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5bb73184-f51a-4fa3-9049-81bc0ab017e8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:34.058677 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5bb73184-f51a-4fa3-9049-81bc0ab017e8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:34.068754 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5bb73184-f51a-4fa3-9049-81bc0ab017e8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.298721 Jul 12 18:28:34.073285 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 204/383] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:33 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:34.785038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e79d1ecc-4424-4006-8150-1e255a3722ff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:34.786430 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e79d1ecc-4424-4006-8150-1e255a3722ff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:34.792639 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e79d1ecc-4424-4006-8150-1e255a3722ff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:34.793080 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e79d1ecc-4424-4006-8150-1e255a3722ff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:34.793843 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e79d1ecc-4424-4006-8150-1e255a3722ff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:34.794266 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e79d1ecc-4424-4006-8150-1e255a3722ff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:34.953661 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e79d1ecc-4424-4006-8150-1e255a3722ff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:34.969879 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e79d1ecc-4424-4006-8150-1e255a3722ff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:34.972669 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e79d1ecc-4424-4006-8150-1e255a3722ff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:34.974711 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e79d1ecc-4424-4006-8150-1e255a3722ff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1751 microversion: 2.20 time: 0.193312 Jul 12 18:28:34.975650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 205/384] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:34 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:35.100726 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0169d8cd-e041-45d8-a697-3629c4d6da31 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:35.101348 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0169d8cd-e041-45d8-a697-3629c4d6da31 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:35.109037 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0169d8cd-e041-45d8-a697-3629c4d6da31 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:35.109490 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0169d8cd-e041-45d8-a697-3629c4d6da31 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:35.110301 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0169d8cd-e041-45d8-a697-3629c4d6da31 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:35.110742 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0169d8cd-e041-45d8-a697-3629c4d6da31 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:35.293926 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0169d8cd-e041-45d8-a697-3629c4d6da31 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:35.305037 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0169d8cd-e041-45d8-a697-3629c4d6da31 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.209745 Jul 12 18:28:35.305875 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 206/385] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:35 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:36.005406 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7a7e2e11-ad42-4aff-999e-ec24b9bb71e3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:36.006237 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7a7e2e11-ad42-4aff-999e-ec24b9bb71e3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:36.013312 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a7e2e11-ad42-4aff-999e-ec24b9bb71e3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:36.013755 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a7e2e11-ad42-4aff-999e-ec24b9bb71e3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:36.017667 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a7e2e11-ad42-4aff-999e-ec24b9bb71e3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:36.017667 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a7e2e11-ad42-4aff-999e-ec24b9bb71e3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:36.187527 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7a7e2e11-ad42-4aff-999e-ec24b9bb71e3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:36.198580 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7a7e2e11-ad42-4aff-999e-ec24b9bb71e3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:36.200458 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7a7e2e11-ad42-4aff-999e-ec24b9bb71e3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:36.201791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7a7e2e11-ad42-4aff-999e-ec24b9bb71e3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1751 microversion: 2.20 time: 0.200875 Jul 12 18:28:36.202390 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 207/386] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:35 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:36.334824 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c57167d5-70dd-407f-b059-cdb1fefa8b7f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:36.334824 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c57167d5-70dd-407f-b059-cdb1fefa8b7f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:36.338513 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c57167d5-70dd-407f-b059-cdb1fefa8b7f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:36.338972 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c57167d5-70dd-407f-b059-cdb1fefa8b7f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:36.339762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c57167d5-70dd-407f-b059-cdb1fefa8b7f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:36.340196 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c57167d5-70dd-407f-b059-cdb1fefa8b7f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:36.541095 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c57167d5-70dd-407f-b059-cdb1fefa8b7f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:36.545158 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=100 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:36.549874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c57167d5-70dd-407f-b059-cdb1fefa8b7f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.223222 Jul 12 18:28:36.550504 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 208/387] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:36 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:36.627554 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-40073cf6-130a-4e67-b741-a1c6cf512e7e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "POST /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.020239 Jul 12 18:28:36.629765 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 180/388] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:28:27 2022] POST /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments => generated 194 bytes in 9023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:28:37.224391 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2cdd6801-0012-4739-927c-7e5cea7be573 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:37.225430 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2cdd6801-0012-4739-927c-7e5cea7be573 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:37.233188 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2cdd6801-0012-4739-927c-7e5cea7be573 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:37.234032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2cdd6801-0012-4739-927c-7e5cea7be573 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:37.235022 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2cdd6801-0012-4739-927c-7e5cea7be573 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:37.235495 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2cdd6801-0012-4739-927c-7e5cea7be573 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:37.397010 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2cdd6801-0012-4739-927c-7e5cea7be573 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:37.411254 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2cdd6801-0012-4739-927c-7e5cea7be573 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:37.414195 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2cdd6801-0012-4739-927c-7e5cea7be573 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:37.416359 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2cdd6801-0012-4739-927c-7e5cea7be573 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1753 microversion: 2.20 time: 0.197119 Jul 12 18:28:37.420144 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 209/389] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:37 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1753 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:37.571606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e7044845-3b32-458d-a1a6-9dc7b3934758 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:37.572614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e7044845-3b32-458d-a1a6-9dc7b3934758 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:37.584247 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e7044845-3b32-458d-a1a6-9dc7b3934758 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:37.584768 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e7044845-3b32-458d-a1a6-9dc7b3934758 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:37.586335 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e7044845-3b32-458d-a1a6-9dc7b3934758 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:37.587098 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e7044845-3b32-458d-a1a6-9dc7b3934758 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:37.823994 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e7044845-3b32-458d-a1a6-9dc7b3934758 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:37.833606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e7044845-3b32-458d-a1a6-9dc7b3934758 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.268089 Jul 12 18:28:37.837361 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 181/390] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:37 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:38.451197 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-73395af5-9401-4884-8703-904b73022db4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:38.451827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-73395af5-9401-4884-8703-904b73022db4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:38.458509 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-73395af5-9401-4884-8703-904b73022db4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:38.458953 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-73395af5-9401-4884-8703-904b73022db4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:38.459738 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-73395af5-9401-4884-8703-904b73022db4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:38.460191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-73395af5-9401-4884-8703-904b73022db4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:38.616910 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-73395af5-9401-4884-8703-904b73022db4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:38.627838 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-73395af5-9401-4884-8703-904b73022db4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:38.630300 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-73395af5-9401-4884-8703-904b73022db4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:38.632539 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-73395af5-9401-4884-8703-904b73022db4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1753 microversion: 2.20 time: 0.184755 Jul 12 18:28:38.633505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 210/391] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:38 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:38.860606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bc971f2e-47ef-4fbe-9544-7aea014e385b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:38.861257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bc971f2e-47ef-4fbe-9544-7aea014e385b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:38.868765 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc971f2e-47ef-4fbe-9544-7aea014e385b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:38.869306 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc971f2e-47ef-4fbe-9544-7aea014e385b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:38.870138 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc971f2e-47ef-4fbe-9544-7aea014e385b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:38.870575 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc971f2e-47ef-4fbe-9544-7aea014e385b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:39.046058 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bc971f2e-47ef-4fbe-9544-7aea014e385b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:39.059975 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bc971f2e-47ef-4fbe-9544-7aea014e385b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.203232 Jul 12 18:28:39.060879 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 182/392] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:38 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:39.652627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-961de01b-587b-45b6-8f22-552f18e36296 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:39.653593 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-961de01b-587b-45b6-8f22-552f18e36296 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:39.659967 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-961de01b-587b-45b6-8f22-552f18e36296 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:39.660450 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-961de01b-587b-45b6-8f22-552f18e36296 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:39.661902 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-961de01b-587b-45b6-8f22-552f18e36296 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:39.662336 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-961de01b-587b-45b6-8f22-552f18e36296 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:39.827763 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-961de01b-587b-45b6-8f22-552f18e36296 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:39.839684 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-961de01b-587b-45b6-8f22-552f18e36296 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:39.843230 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-961de01b-587b-45b6-8f22-552f18e36296 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:39.845236 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-961de01b-587b-45b6-8f22-552f18e36296 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1753 microversion: 2.20 time: 0.196520 Jul 12 18:28:39.846254 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 211/393] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:39 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:40.077951 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c770a349-b6b3-4704-8c60-aad9ec892278 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:40.079224 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c770a349-b6b3-4704-8c60-aad9ec892278 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:40.087117 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c770a349-b6b3-4704-8c60-aad9ec892278 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:40.087568 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c770a349-b6b3-4704-8c60-aad9ec892278 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:40.088601 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c770a349-b6b3-4704-8c60-aad9ec892278 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:40.089220 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c770a349-b6b3-4704-8c60-aad9ec892278 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:40.289592 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c770a349-b6b3-4704-8c60-aad9ec892278 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:40.305617 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c770a349-b6b3-4704-8c60-aad9ec892278 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.231169 Jul 12 18:28:40.307058 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 183/394] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:40 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:40.868081 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b8e69ce7-e114-439f-84c6-252311b8266d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:40.869091 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b8e69ce7-e114-439f-84c6-252311b8266d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:40.877922 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b8e69ce7-e114-439f-84c6-252311b8266d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:40.879014 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b8e69ce7-e114-439f-84c6-252311b8266d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:40.880301 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b8e69ce7-e114-439f-84c6-252311b8266d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:40.882261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b8e69ce7-e114-439f-84c6-252311b8266d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:41.056215 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b8e69ce7-e114-439f-84c6-252311b8266d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:41.065909 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b8e69ce7-e114-439f-84c6-252311b8266d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:41.068071 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b8e69ce7-e114-439f-84c6-252311b8266d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:41.069318 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b8e69ce7-e114-439f-84c6-252311b8266d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1753 microversion: 2.20 time: 0.207814 Jul 12 18:28:41.069889 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 212/395] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:40 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:41.335796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5a1962b5-28b1-4383-8bee-f23e4d07a91c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:41.336677 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5a1962b5-28b1-4383-8bee-f23e4d07a91c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:41.345552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a1962b5-28b1-4383-8bee-f23e4d07a91c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:41.346177 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a1962b5-28b1-4383-8bee-f23e4d07a91c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:41.347481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a1962b5-28b1-4383-8bee-f23e4d07a91c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:41.347899 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a1962b5-28b1-4383-8bee-f23e4d07a91c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:41.631233 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5a1962b5-28b1-4383-8bee-f23e4d07a91c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:41.641018 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5a1962b5-28b1-4383-8bee-f23e4d07a91c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.311379 Jul 12 18:28:41.642000 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 184/396] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:41 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:42.096622 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-da50881e-b9b5-4e84-b75c-704e789f0d21 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:42.097779 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-da50881e-b9b5-4e84-b75c-704e789f0d21 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:42.101988 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:42.112682 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-da50881e-b9b5-4e84-b75c-704e789f0d21 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:42.113466 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-da50881e-b9b5-4e84-b75c-704e789f0d21 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:42.116375 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-da50881e-b9b5-4e84-b75c-704e789f0d21 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:42.117445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-da50881e-b9b5-4e84-b75c-704e789f0d21 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:42.375474 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-da50881e-b9b5-4e84-b75c-704e789f0d21 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:42.399384 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-da50881e-b9b5-4e84-b75c-704e789f0d21 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:42.403670 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-da50881e-b9b5-4e84-b75c-704e789f0d21 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:42.407001 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-da50881e-b9b5-4e84-b75c-704e789f0d21 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.320139 Jul 12 18:28:42.408490 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 213/397] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:42 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:42.662733 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fad3e5b3-a7df-4aba-8c85-d89e3ae89875 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:42.664963 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fad3e5b3-a7df-4aba-8c85-d89e3ae89875 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:42.686328 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fad3e5b3-a7df-4aba-8c85-d89e3ae89875 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:42.687389 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fad3e5b3-a7df-4aba-8c85-d89e3ae89875 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:42.688873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fad3e5b3-a7df-4aba-8c85-d89e3ae89875 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:42.689645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fad3e5b3-a7df-4aba-8c85-d89e3ae89875 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:42.927786 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fad3e5b3-a7df-4aba-8c85-d89e3ae89875 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:42.938717 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fad3e5b3-a7df-4aba-8c85-d89e3ae89875 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.280979 Jul 12 18:28:42.939945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 185/398] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:42 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:43.059677 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-9b689e0b-9524-42b5-8abf-4be48b649e55 req-3aee33f7-7575-4fae-8487-28aaf6332ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c546fb53-6e12-426c-99a6-e6264514203d", "name": "network-vif-plugged", "status": "completed", "tag": "6becd9b8-f6f0-4c1e-8ce2-67eb379069f7"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:43.078512 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-9b689e0b-9524-42b5-8abf-4be48b649e55 req-3aee33f7-7575-4fae-8487-28aaf6332ffb service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:43.079295 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-9b689e0b-9524-42b5-8abf-4be48b649e55 req-3aee33f7-7575-4fae-8487-28aaf6332ffb service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:43.102114 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-9b689e0b-9524-42b5-8abf-4be48b649e55 req-3aee33f7-7575-4fae-8487-28aaf6332ffb service nova] Creating event network-vif-plugged:6becd9b8-f6f0-4c1e-8ce2-67eb379069f7 for instance c546fb53-6e12-426c-99a6-e6264514203d on hv-cinder-84488 Jul 12 18:28:43.111493 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-9b689e0b-9524-42b5-8abf-4be48b649e55 req-3aee33f7-7575-4fae-8487-28aaf6332ffb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057143 Jul 12 18:28:43.112409 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 214/399] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:28:43.443063 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2cb29589-c812-4e99-94eb-2ea736c08f59 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:43.451459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2cb29589-c812-4e99-94eb-2ea736c08f59 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:43.461488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2cb29589-c812-4e99-94eb-2ea736c08f59 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:43.462357 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2cb29589-c812-4e99-94eb-2ea736c08f59 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:43.463761 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2cb29589-c812-4e99-94eb-2ea736c08f59 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:43.464547 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2cb29589-c812-4e99-94eb-2ea736c08f59 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:43.840198 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2cb29589-c812-4e99-94eb-2ea736c08f59 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:43.852908 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2cb29589-c812-4e99-94eb-2ea736c08f59 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:43.855024 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2cb29589-c812-4e99-94eb-2ea736c08f59 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:43.856959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2cb29589-c812-4e99-94eb-2ea736c08f59 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.422540 Jul 12 18:28:43.857915 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 186/400] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:43 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:43.947182 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6ee9bb11-865e-4679-b357-f345cd8ea06f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:43.948262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6ee9bb11-865e-4679-b357-f345cd8ea06f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:43.958754 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6ee9bb11-865e-4679-b357-f345cd8ea06f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:43.959468 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6ee9bb11-865e-4679-b357-f345cd8ea06f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:43.962301 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6ee9bb11-865e-4679-b357-f345cd8ea06f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:43.963015 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6ee9bb11-865e-4679-b357-f345cd8ea06f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:43.971609 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3eaeff0e-9033-48e2-b197-0d6ebff61710 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:43.973108 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3eaeff0e-9033-48e2-b197-0d6ebff61710 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:43.987934 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3eaeff0e-9033-48e2-b197-0d6ebff61710 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:43.989118 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3eaeff0e-9033-48e2-b197-0d6ebff61710 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:43.990739 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3eaeff0e-9033-48e2-b197-0d6ebff61710 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:43.991636 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3eaeff0e-9033-48e2-b197-0d6ebff61710 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:44.280263 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-6ee9bb11-865e-4679-b357-f345cd8ea06f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lazy-loading 'services' on Instance uuid 5f6ad973-f294-4c83-bb32-5d90270ada90 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:28:44.474972 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3eaeff0e-9033-48e2-b197-0d6ebff61710 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:44.483396 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3eaeff0e-9033-48e2-b197-0d6ebff61710 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.517718 Jul 12 18:28:44.484646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 187/401] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:43 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:44.716376 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6ee9bb11-865e-4679-b357-f345cd8ea06f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/os-volume_attachments/35f9177d-d493-41bb-9cf7-6c2ce4f8b628" status: 202 len: 0 microversion: 2.1 time: 0.773593 Jul 12 18:28:44.719225 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 215/402] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:28:43 2022] DELETE /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/os-volume_attachments/35f9177d-d493-41bb-9cf7-6c2ce4f8b628 => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:28:44.886920 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c4334157-ea68-4a9d-b15f-5b06be863a83 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:44.887514 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c4334157-ea68-4a9d-b15f-5b06be863a83 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:44.907129 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4334157-ea68-4a9d-b15f-5b06be863a83 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:44.908281 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4334157-ea68-4a9d-b15f-5b06be863a83 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:44.909217 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4334157-ea68-4a9d-b15f-5b06be863a83 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:44.913062 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4334157-ea68-4a9d-b15f-5b06be863a83 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:45.168724 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c4334157-ea68-4a9d-b15f-5b06be863a83 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:45.199319 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c4334157-ea68-4a9d-b15f-5b06be863a83 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:45.204058 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c4334157-ea68-4a9d-b15f-5b06be863a83 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:45.206691 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c4334157-ea68-4a9d-b15f-5b06be863a83 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.329881 Jul 12 18:28:45.208578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 188/403] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:44 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:45.509758 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-58d50257-2d50-4997-a6a2-732583a49ad4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:45.512061 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-58d50257-2d50-4997-a6a2-732583a49ad4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:45.526885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58d50257-2d50-4997-a6a2-732583a49ad4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:45.527629 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58d50257-2d50-4997-a6a2-732583a49ad4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:45.529510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58d50257-2d50-4997-a6a2-732583a49ad4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:45.530468 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58d50257-2d50-4997-a6a2-732583a49ad4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:45.913461 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-58d50257-2d50-4997-a6a2-732583a49ad4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:45.942089 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-58d50257-2d50-4997-a6a2-732583a49ad4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1358 microversion: 2.1 time: 0.438035 Jul 12 18:28:45.944249 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 216/404] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:45 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1358 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:46.268229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-96d8cb0d-2500-455c-ab0a-0fe9173e1b9a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:46.269313 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-96d8cb0d-2500-455c-ab0a-0fe9173e1b9a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:46.293859 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96d8cb0d-2500-455c-ab0a-0fe9173e1b9a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:46.294672 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96d8cb0d-2500-455c-ab0a-0fe9173e1b9a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:46.296282 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96d8cb0d-2500-455c-ab0a-0fe9173e1b9a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:46.298005 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96d8cb0d-2500-455c-ab0a-0fe9173e1b9a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:46.554946 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-96d8cb0d-2500-455c-ab0a-0fe9173e1b9a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:46.558972 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:46.570618 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-96d8cb0d-2500-455c-ab0a-0fe9173e1b9a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:46.572288 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-96d8cb0d-2500-455c-ab0a-0fe9173e1b9a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:46.573810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-96d8cb0d-2500-455c-ab0a-0fe9173e1b9a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.332049 Jul 12 18:28:46.574912 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 189/405] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:46 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:46.977580 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-93a6ed66-f286-4900-b356-4a08e27ce45e tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:46.994042 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-93a6ed66-f286-4900-b356-4a08e27ce45e tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:47.010330 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-93a6ed66-f286-4900-b356-4a08e27ce45e tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:47.011760 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-93a6ed66-f286-4900-b356-4a08e27ce45e tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:47.013541 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-93a6ed66-f286-4900-b356-4a08e27ce45e tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:47.014619 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-93a6ed66-f286-4900-b356-4a08e27ce45e tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:47.436235 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-93a6ed66-f286-4900-b356-4a08e27ce45e tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:47.454470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-93a6ed66-f286-4900-b356-4a08e27ce45e tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1549 microversion: 2.1 time: 0.484193 Jul 12 18:28:47.455964 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 217/406] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:46 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1549 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:47.476910 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4c006de7-04e4-42ac-8fda-594ac6d830c9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:47.484614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4c006de7-04e4-42ac-8fda-594ac6d830c9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:47.487722 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c006de7-04e4-42ac-8fda-594ac6d830c9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:47.488200 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c006de7-04e4-42ac-8fda-594ac6d830c9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:47.489218 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c006de7-04e4-42ac-8fda-594ac6d830c9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:47.489662 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c006de7-04e4-42ac-8fda-594ac6d830c9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:47.627103 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-17197561-5857-4a47-982a-f85c9b457660 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:47.634004 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-17197561-5857-4a47-982a-f85c9b457660 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:47.656377 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-17197561-5857-4a47-982a-f85c9b457660 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:47.662714 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-17197561-5857-4a47-982a-f85c9b457660 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:47.666297 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-17197561-5857-4a47-982a-f85c9b457660 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:47.667324 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-17197561-5857-4a47-982a-f85c9b457660 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:47.757663 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4c006de7-04e4-42ac-8fda-594ac6d830c9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:47.786608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4c006de7-04e4-42ac-8fda-594ac6d830c9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1549 microversion: 2.1 time: 0.310961 Jul 12 18:28:47.792501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 190/407] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:47 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1549 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:47.829137 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6c8cbf35-1297-4015-a1ab-41767c46d79f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:47.837839 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6c8cbf35-1297-4015-a1ab-41767c46d79f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:47.840443 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6c8cbf35-1297-4015-a1ab-41767c46d79f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Searching by: {'deleted': False, 'project_id': 'c9b591880e9441acac9ddf006a5f9959'} {{(pid=118410) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 18:28:47.863127 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c8cbf35-1297-4015-a1ab-41767c46d79f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:47.865942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c8cbf35-1297-4015-a1ab-41767c46d79f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:47.867866 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c8cbf35-1297-4015-a1ab-41767c46d79f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:47.869118 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c8cbf35-1297-4015-a1ab-41767c46d79f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:48.056607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-17197561-5857-4a47-982a-f85c9b457660 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:48.096458 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-17197561-5857-4a47-982a-f85c9b457660 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:48.101665 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-17197561-5857-4a47-982a-f85c9b457660 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:48.103424 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-17197561-5857-4a47-982a-f85c9b457660 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.499495 Jul 12 18:28:48.108428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 218/408] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:47 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:48.149289 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.multi_cell_list [None req-6c8cbf35-1297-4015-a1ab-41767c46d79f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118410) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 18:28:48.401953 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6c8cbf35-1297-4015-a1ab-41767c46d79f tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.596601 Jul 12 18:28:48.403036 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 191/409] 10.222.0.47 () {58 vars in 1124 bytes} [Tue Jul 12 18:28:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:28:48.431289 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-049afe18-9c2f-485a-b40b-961fd987740a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:48.431289 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-049afe18-9c2f-485a-b40b-961fd987740a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:48.437960 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-049afe18-9c2f-485a-b40b-961fd987740a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:48.438771 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-049afe18-9c2f-485a-b40b-961fd987740a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:48.440016 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-049afe18-9c2f-485a-b40b-961fd987740a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:48.440817 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-049afe18-9c2f-485a-b40b-961fd987740a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:48.669930 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-049afe18-9c2f-485a-b40b-961fd987740a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:48.695787 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-049afe18-9c2f-485a-b40b-961fd987740a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1549 microversion: 2.1 time: 0.280941 Jul 12 18:28:48.696728 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 219/410] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:48 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1549 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:49.126481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c514140f-8994-4618-9cd0-11ebc0d89cd7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:49.132470 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c514140f-8994-4618-9cd0-11ebc0d89cd7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:49.144109 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c514140f-8994-4618-9cd0-11ebc0d89cd7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:49.145076 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c514140f-8994-4618-9cd0-11ebc0d89cd7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:49.146948 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c514140f-8994-4618-9cd0-11ebc0d89cd7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:49.147634 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c514140f-8994-4618-9cd0-11ebc0d89cd7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:49.391128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c514140f-8994-4618-9cd0-11ebc0d89cd7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:49.399078 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c514140f-8994-4618-9cd0-11ebc0d89cd7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:49.401470 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c514140f-8994-4618-9cd0-11ebc0d89cd7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:49.403212 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c514140f-8994-4618-9cd0-11ebc0d89cd7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.281551 Jul 12 18:28:49.405174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 192/411] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:49 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:50.440634 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7b63f9c4-b859-40e9-806f-c3d21bbee68f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:50.450687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7b63f9c4-b859-40e9-806f-c3d21bbee68f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:50.463224 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7b63f9c4-b859-40e9-806f-c3d21bbee68f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:50.463880 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7b63f9c4-b859-40e9-806f-c3d21bbee68f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:50.464991 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7b63f9c4-b859-40e9-806f-c3d21bbee68f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:50.465714 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7b63f9c4-b859-40e9-806f-c3d21bbee68f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:50.796923 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7b63f9c4-b859-40e9-806f-c3d21bbee68f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:50.819804 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7b63f9c4-b859-40e9-806f-c3d21bbee68f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:50.836171 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7b63f9c4-b859-40e9-806f-c3d21bbee68f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:50.840551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7b63f9c4-b859-40e9-806f-c3d21bbee68f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.408010 Jul 12 18:28:50.850155 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 220/412] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:50 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:51.581348 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cc26da7f-2c7d-48f0-9ff9-2212d3f6d847 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4af5c7b4-5004-4451-8b01-28ea9d66bae4"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:51.585702 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cc26da7f-2c7d-48f0-9ff9-2212d3f6d847 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:51.662093 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cc26da7f-2c7d-48f0-9ff9-2212d3f6d847 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:51.662093 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cc26da7f-2c7d-48f0-9ff9-2212d3f6d847 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:51.662093 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cc26da7f-2c7d-48f0-9ff9-2212d3f6d847 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:51.662093 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cc26da7f-2c7d-48f0-9ff9-2212d3f6d847 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:51.879529 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-59fd797b-fb72-42f2-a236-7d4416bcb447 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:51.881162 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-59fd797b-fb72-42f2-a236-7d4416bcb447 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:51.888979 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-59fd797b-fb72-42f2-a236-7d4416bcb447 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:51.889703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-59fd797b-fb72-42f2-a236-7d4416bcb447 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:51.890598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-59fd797b-fb72-42f2-a236-7d4416bcb447 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:51.891115 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-59fd797b-fb72-42f2-a236-7d4416bcb447 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:52.149862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-59fd797b-fb72-42f2-a236-7d4416bcb447 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:52.194235 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-59fd797b-fb72-42f2-a236-7d4416bcb447 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:52.222862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-59fd797b-fb72-42f2-a236-7d4416bcb447 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:52.225269 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-59fd797b-fb72-42f2-a236-7d4416bcb447 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.353735 Jul 12 18:28:52.238735 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 221/413] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:51 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:28:52.324194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-94fd6efb-1f54-4065-af44-3b16207fa206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:52.326558 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-94fd6efb-1f54-4065-af44-3b16207fa206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:52.335644 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-94fd6efb-1f54-4065-af44-3b16207fa206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:52.336504 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-94fd6efb-1f54-4065-af44-3b16207fa206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:52.337576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-94fd6efb-1f54-4065-af44-3b16207fa206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:52.338687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-94fd6efb-1f54-4065-af44-3b16207fa206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:52.376535 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-94fd6efb-1f54-4065-af44-3b16207fa206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lazy-loading 'flavor' on Instance uuid f7062eaf-78a1-4879-9edb-6465141472bc {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:28:53.054271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-94fd6efb-1f54-4065-af44-3b16207fa206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "POST /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/action" status: 200 len: 32 microversion: 2.1 time: 0.736832 Jul 12 18:28:53.055544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 222/414] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:28:52 2022] POST /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/action => generated 32 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:28:53.074180 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-22aeb5d2-56e1-4aad-b30f-eefbb0240206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:53.075951 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-22aeb5d2-56e1-4aad-b30f-eefbb0240206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:53.090556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-22aeb5d2-56e1-4aad-b30f-eefbb0240206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:53.091375 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-22aeb5d2-56e1-4aad-b30f-eefbb0240206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:53.092636 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-22aeb5d2-56e1-4aad-b30f-eefbb0240206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:53.093414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-22aeb5d2-56e1-4aad-b30f-eefbb0240206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:53.141715 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:53.376259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-22aeb5d2-56e1-4aad-b30f-eefbb0240206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:53.389680 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-22aeb5d2-56e1-4aad-b30f-eefbb0240206 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.325255 Jul 12 18:28:53.390833 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 223/415] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:53 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:53.396522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3fc2b1ad-9d9a-4723-aeb6-9a792e911ce8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:53.397054 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3fc2b1ad-9d9a-4723-aeb6-9a792e911ce8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:53.414902 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3fc2b1ad-9d9a-4723-aeb6-9a792e911ce8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:53.415706 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3fc2b1ad-9d9a-4723-aeb6-9a792e911ce8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:53.416885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3fc2b1ad-9d9a-4723-aeb6-9a792e911ce8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:53.417575 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3fc2b1ad-9d9a-4723-aeb6-9a792e911ce8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:53.638840 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3fc2b1ad-9d9a-4723-aeb6-9a792e911ce8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:53.667890 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3fc2b1ad-9d9a-4723-aeb6-9a792e911ce8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:53.670986 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3fc2b1ad-9d9a-4723-aeb6-9a792e911ce8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:53.673373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3fc2b1ad-9d9a-4723-aeb6-9a792e911ce8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.281223 Jul 12 18:28:53.674708 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 224/416] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:53 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:54.427935 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-de95568d-d7cf-49f0-8790-c5af5edd51a3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:54.430297 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-de95568d-d7cf-49f0-8790-c5af5edd51a3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:54.472583 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-de95568d-d7cf-49f0-8790-c5af5edd51a3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:54.473032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-de95568d-d7cf-49f0-8790-c5af5edd51a3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:54.477154 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-de95568d-d7cf-49f0-8790-c5af5edd51a3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:54.477843 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-de95568d-d7cf-49f0-8790-c5af5edd51a3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:54.711865 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-de95568d-d7cf-49f0-8790-c5af5edd51a3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:54.724717 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-de95568d-d7cf-49f0-8790-c5af5edd51a3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.305293 Jul 12 18:28:54.725586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 225/417] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:54 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:54.741966 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-00a23351-2070-4c37-94b8-aa8af17b35fa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:54.742982 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-00a23351-2070-4c37-94b8-aa8af17b35fa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:54.751351 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-00a23351-2070-4c37-94b8-aa8af17b35fa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:54.752106 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-00a23351-2070-4c37-94b8-aa8af17b35fa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:54.753056 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-00a23351-2070-4c37-94b8-aa8af17b35fa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:54.753651 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-00a23351-2070-4c37-94b8-aa8af17b35fa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:54.938397 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-00a23351-2070-4c37-94b8-aa8af17b35fa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:54.947236 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-00a23351-2070-4c37-94b8-aa8af17b35fa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:54.952221 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-00a23351-2070-4c37-94b8-aa8af17b35fa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:54.952221 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-00a23351-2070-4c37-94b8-aa8af17b35fa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.223325 Jul 12 18:28:54.952221 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 226/418] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:54 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:55.750924 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-06bd930f-39c5-4044-935c-5c302ca1f456 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:55.751624 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-06bd930f-39c5-4044-935c-5c302ca1f456 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:55.762515 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-06bd930f-39c5-4044-935c-5c302ca1f456 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:55.762967 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-06bd930f-39c5-4044-935c-5c302ca1f456 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:55.763757 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-06bd930f-39c5-4044-935c-5c302ca1f456 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:55.764214 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-06bd930f-39c5-4044-935c-5c302ca1f456 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:55.943409 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-06bd930f-39c5-4044-935c-5c302ca1f456 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:55.952982 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-06bd930f-39c5-4044-935c-5c302ca1f456 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.205833 Jul 12 18:28:55.964173 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 227/419] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:55 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:55.969580 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-807e6402-3c9d-491e-8761-d8b042eb77a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:55.970537 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-807e6402-3c9d-491e-8761-d8b042eb77a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:55.978006 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-807e6402-3c9d-491e-8761-d8b042eb77a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:55.978928 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-807e6402-3c9d-491e-8761-d8b042eb77a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:55.979889 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-807e6402-3c9d-491e-8761-d8b042eb77a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:55.980539 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-807e6402-3c9d-491e-8761-d8b042eb77a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:56.187084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-807e6402-3c9d-491e-8761-d8b042eb77a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:56.205083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-807e6402-3c9d-491e-8761-d8b042eb77a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:56.207396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-807e6402-3c9d-491e-8761-d8b042eb77a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:56.209094 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-807e6402-3c9d-491e-8761-d8b042eb77a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.243528 Jul 12 18:28:56.210354 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 228/420] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:55 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:56.581515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cc26da7f-2c7d-48f0-9ff9-2212d3f6d847 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "POST /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.006875 Jul 12 18:28:56.585700 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 193/421] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:28:51 2022] POST /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments => generated 194 bytes in 5009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:28:56.974228 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f8dfe87f-d861-4764-93b5-bc0dac25c998 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:56.975112 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f8dfe87f-d861-4764-93b5-bc0dac25c998 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:56.982518 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8dfe87f-d861-4764-93b5-bc0dac25c998 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:56.985775 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8dfe87f-d861-4764-93b5-bc0dac25c998 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:56.985775 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8dfe87f-d861-4764-93b5-bc0dac25c998 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:56.985775 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8dfe87f-d861-4764-93b5-bc0dac25c998 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:57.135733 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f8dfe87f-d861-4764-93b5-bc0dac25c998 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:57.150917 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f8dfe87f-d861-4764-93b5-bc0dac25c998 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.183212 Jul 12 18:28:57.154840 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 229/422] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:56 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:28:57.244652 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4a441dfd-6897-4f13-aeac-48ac7eab6782 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:57.244652 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4a441dfd-6897-4f13-aeac-48ac7eab6782 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:57.253118 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4a441dfd-6897-4f13-aeac-48ac7eab6782 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:57.253812 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4a441dfd-6897-4f13-aeac-48ac7eab6782 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:57.256094 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4a441dfd-6897-4f13-aeac-48ac7eab6782 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:57.256605 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4a441dfd-6897-4f13-aeac-48ac7eab6782 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:57.402024 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4a441dfd-6897-4f13-aeac-48ac7eab6782 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:57.411223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4a441dfd-6897-4f13-aeac-48ac7eab6782 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:57.412794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4a441dfd-6897-4f13-aeac-48ac7eab6782 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:57.413980 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4a441dfd-6897-4f13-aeac-48ac7eab6782 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.183308 Jul 12 18:28:57.414555 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 194/423] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:57 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:57.647646 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a3da20e8-36e6-421d-9cdd-d210f69af353 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:28:57.658220 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a3da20e8-36e6-421d-9cdd-d210f69af353 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:57.658939 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a3da20e8-36e6-421d-9cdd-d210f69af353 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:57.690582 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a3da20e8-36e6-421d-9cdd-d210f69af353 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Going to try to stop instance {{(pid=118411) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 18:28:57.866192 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a3da20e8-36e6-421d-9cdd-d210f69af353 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "POST /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/action" status: 202 len: 0 microversion: 2.1 time: 0.224229 Jul 12 18:28:57.867200 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 230/424] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:28:57 2022] POST /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:28:57.876378 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4537c7fc-ada1-4a50-a6e2-e76bf3fbbd01 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:57.877431 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4537c7fc-ada1-4a50-a6e2-e76bf3fbbd01 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:57.883563 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=30 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:57.886078 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4537c7fc-ada1-4a50-a6e2-e76bf3fbbd01 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:57.886522 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4537c7fc-ada1-4a50-a6e2-e76bf3fbbd01 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:57.887327 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4537c7fc-ada1-4a50-a6e2-e76bf3fbbd01 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:57.887740 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4537c7fc-ada1-4a50-a6e2-e76bf3fbbd01 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:57.964678 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:58.044839 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4537c7fc-ada1-4a50-a6e2-e76bf3fbbd01 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:58.053223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4537c7fc-ada1-4a50-a6e2-e76bf3fbbd01 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.181194 Jul 12 18:28:58.053827 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 195/425] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:57 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:58.177667 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8bdc1f01-46fa-40de-b583-c8a5591cffbb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:58.178332 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8bdc1f01-46fa-40de-b583-c8a5591cffbb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:58.185784 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8bdc1f01-46fa-40de-b583-c8a5591cffbb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:58.186314 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8bdc1f01-46fa-40de-b583-c8a5591cffbb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:58.187178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8bdc1f01-46fa-40de-b583-c8a5591cffbb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:58.187669 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8bdc1f01-46fa-40de-b583-c8a5591cffbb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:58.344450 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8bdc1f01-46fa-40de-b583-c8a5591cffbb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:58.354714 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8bdc1f01-46fa-40de-b583-c8a5591cffbb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.181914 Jul 12 18:28:58.355333 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 231/426] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:58 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:58.433880 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0d622caa-881d-401b-907d-1097ccc393f4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:58.434558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0d622caa-881d-401b-907d-1097ccc393f4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:58.445174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0d622caa-881d-401b-907d-1097ccc393f4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:58.445847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0d622caa-881d-401b-907d-1097ccc393f4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:58.447037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0d622caa-881d-401b-907d-1097ccc393f4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:58.447688 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0d622caa-881d-401b-907d-1097ccc393f4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:58.613646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0d622caa-881d-401b-907d-1097ccc393f4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:58.623846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0d622caa-881d-401b-907d-1097ccc393f4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:58.633408 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0d622caa-881d-401b-907d-1097ccc393f4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:58.633408 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0d622caa-881d-401b-907d-1097ccc393f4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.197732 Jul 12 18:28:58.633408 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 196/427] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:58 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:28:59.072795 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a8773aca-a165-472c-93de-b3ef683e0206 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:59.073629 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a8773aca-a165-472c-93de-b3ef683e0206 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:59.083861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a8773aca-a165-472c-93de-b3ef683e0206 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:59.084345 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a8773aca-a165-472c-93de-b3ef683e0206 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:59.085152 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a8773aca-a165-472c-93de-b3ef683e0206 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:59.085595 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a8773aca-a165-472c-93de-b3ef683e0206 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:59.234885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a8773aca-a165-472c-93de-b3ef683e0206 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:59.242750 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a8773aca-a165-472c-93de-b3ef683e0206 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.174548 Jul 12 18:28:59.243326 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 232/428] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:59 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:59.373560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d5fec15f-469f-407c-a783-739e9863bb47 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:59.374169 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d5fec15f-469f-407c-a783-739e9863bb47 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:59.380871 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d5fec15f-469f-407c-a783-739e9863bb47 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:59.381294 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d5fec15f-469f-407c-a783-739e9863bb47 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:59.382064 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d5fec15f-469f-407c-a783-739e9863bb47 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:59.382486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d5fec15f-469f-407c-a783-739e9863bb47 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:59.568080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d5fec15f-469f-407c-a783-739e9863bb47 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:59.577010 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d5fec15f-469f-407c-a783-739e9863bb47 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.207923 Jul 12 18:28:59.587315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 197/429] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:28:59 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:28:59.650753 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a99794a4-6eb3-4ed1-ad62-cef7bd3de19e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:28:59.651373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a99794a4-6eb3-4ed1-ad62-cef7bd3de19e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:28:59.663915 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a99794a4-6eb3-4ed1-ad62-cef7bd3de19e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:59.664411 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a99794a4-6eb3-4ed1-ad62-cef7bd3de19e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:59.665212 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a99794a4-6eb3-4ed1-ad62-cef7bd3de19e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:28:59.665647 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a99794a4-6eb3-4ed1-ad62-cef7bd3de19e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:28:59.823946 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a99794a4-6eb3-4ed1-ad62-cef7bd3de19e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:59.834953 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a99794a4-6eb3-4ed1-ad62-cef7bd3de19e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:59.836516 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a99794a4-6eb3-4ed1-ad62-cef7bd3de19e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:28:59.837709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a99794a4-6eb3-4ed1-ad62-cef7bd3de19e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.191298 Jul 12 18:28:59.838278 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 233/430] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:28:59 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:29:00.268092 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-90e633a0-803e-4ad7-acf0-e2be42a9e1d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:00.268775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-90e633a0-803e-4ad7-acf0-e2be42a9e1d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:00.276260 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90e633a0-803e-4ad7-acf0-e2be42a9e1d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:00.276732 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90e633a0-803e-4ad7-acf0-e2be42a9e1d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:00.277520 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90e633a0-803e-4ad7-acf0-e2be42a9e1d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:00.277950 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90e633a0-803e-4ad7-acf0-e2be42a9e1d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:00.450713 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-90e633a0-803e-4ad7-acf0-e2be42a9e1d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:00.462570 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-90e633a0-803e-4ad7-acf0-e2be42a9e1d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.198243 Jul 12 18:29:00.463470 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 198/431] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:00 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:00.597449 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7c842594-6cd7-480b-87ec-5b35c92b588a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:00.598110 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7c842594-6cd7-480b-87ec-5b35c92b588a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:00.604583 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7c842594-6cd7-480b-87ec-5b35c92b588a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:00.605032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7c842594-6cd7-480b-87ec-5b35c92b588a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:00.605940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7c842594-6cd7-480b-87ec-5b35c92b588a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:00.606298 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7c842594-6cd7-480b-87ec-5b35c92b588a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:00.778314 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7c842594-6cd7-480b-87ec-5b35c92b588a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:00.786898 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7c842594-6cd7-480b-87ec-5b35c92b588a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.195029 Jul 12 18:29:00.787523 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 234/432] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:00 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:00.855745 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-856363d9-8bb4-47d8-9cc0-efd80a133492 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:00.856256 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-856363d9-8bb4-47d8-9cc0-efd80a133492 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:00.865078 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-856363d9-8bb4-47d8-9cc0-efd80a133492 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:00.865518 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-856363d9-8bb4-47d8-9cc0-efd80a133492 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:00.870340 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-856363d9-8bb4-47d8-9cc0-efd80a133492 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:00.870340 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-856363d9-8bb4-47d8-9cc0-efd80a133492 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:01.053130 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-856363d9-8bb4-47d8-9cc0-efd80a133492 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:01.068601 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-856363d9-8bb4-47d8-9cc0-efd80a133492 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:01.075506 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-856363d9-8bb4-47d8-9cc0-efd80a133492 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:01.075506 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-856363d9-8bb4-47d8-9cc0-efd80a133492 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.221691 Jul 12 18:29:01.075506 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 199/433] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:00 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:29:01.480927 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4682fe24-fa29-4bb7-999c-793d9402194e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:01.481616 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4682fe24-fa29-4bb7-999c-793d9402194e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:01.488080 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4682fe24-fa29-4bb7-999c-793d9402194e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:01.488565 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4682fe24-fa29-4bb7-999c-793d9402194e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:01.490183 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4682fe24-fa29-4bb7-999c-793d9402194e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:01.490630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4682fe24-fa29-4bb7-999c-793d9402194e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:01.634805 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4682fe24-fa29-4bb7-999c-793d9402194e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:01.642487 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4682fe24-fa29-4bb7-999c-793d9402194e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.165447 Jul 12 18:29:01.643051 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 235/434] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:01 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:01.805080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2ec82592-f052-4126-b78f-3ff0a199ec46 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:01.810589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2ec82592-f052-4126-b78f-3ff0a199ec46 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:01.812783 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ec82592-f052-4126-b78f-3ff0a199ec46 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:01.813227 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ec82592-f052-4126-b78f-3ff0a199ec46 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:01.814084 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ec82592-f052-4126-b78f-3ff0a199ec46 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:01.814557 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ec82592-f052-4126-b78f-3ff0a199ec46 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:01.958002 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2ec82592-f052-4126-b78f-3ff0a199ec46 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:01.967134 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2ec82592-f052-4126-b78f-3ff0a199ec46 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.167195 Jul 12 18:29:01.967960 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 200/435] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:01 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:02.097137 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-19e6ffc1-7a43-44f5-8a1f-ac220b4ab7c7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:02.097137 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-19e6ffc1-7a43-44f5-8a1f-ac220b4ab7c7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:02.106524 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-19e6ffc1-7a43-44f5-8a1f-ac220b4ab7c7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:02.107035 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-19e6ffc1-7a43-44f5-8a1f-ac220b4ab7c7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:02.108124 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-19e6ffc1-7a43-44f5-8a1f-ac220b4ab7c7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:02.108905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-19e6ffc1-7a43-44f5-8a1f-ac220b4ab7c7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:02.268187 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-19e6ffc1-7a43-44f5-8a1f-ac220b4ab7c7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:02.278699 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-19e6ffc1-7a43-44f5-8a1f-ac220b4ab7c7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:02.279970 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-19e6ffc1-7a43-44f5-8a1f-ac220b4ab7c7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:02.281294 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-19e6ffc1-7a43-44f5-8a1f-ac220b4ab7c7 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.189512 Jul 12 18:29:02.281856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 236/436] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:02 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:29:02.661766 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b9899f21-29bd-497a-8d11-4cd6373ff24e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:02.662395 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b9899f21-29bd-497a-8d11-4cd6373ff24e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:02.668891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9899f21-29bd-497a-8d11-4cd6373ff24e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:02.669335 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9899f21-29bd-497a-8d11-4cd6373ff24e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:02.670140 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9899f21-29bd-497a-8d11-4cd6373ff24e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:02.670567 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9899f21-29bd-497a-8d11-4cd6373ff24e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:02.835367 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b9899f21-29bd-497a-8d11-4cd6373ff24e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:02.844094 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b9899f21-29bd-497a-8d11-4cd6373ff24e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.187129 Jul 12 18:29:02.844875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 201/437] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:02 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:02.987555 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-40583e97-5fdb-4efe-b6cf-48ebac7dde82 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:02.988365 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-40583e97-5fdb-4efe-b6cf-48ebac7dde82 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:02.996568 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-40583e97-5fdb-4efe-b6cf-48ebac7dde82 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:02.997193 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-40583e97-5fdb-4efe-b6cf-48ebac7dde82 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:02.998509 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-40583e97-5fdb-4efe-b6cf-48ebac7dde82 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:02.999237 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-40583e97-5fdb-4efe-b6cf-48ebac7dde82 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:03.300682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-030a8c22-50b6-4a1a-a0b5-c7185d96dd1f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:03.302939 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-030a8c22-50b6-4a1a-a0b5-c7185d96dd1f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:03.310998 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-030a8c22-50b6-4a1a-a0b5-c7185d96dd1f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:03.311793 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-030a8c22-50b6-4a1a-a0b5-c7185d96dd1f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:03.312876 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-030a8c22-50b6-4a1a-a0b5-c7185d96dd1f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:03.313476 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-030a8c22-50b6-4a1a-a0b5-c7185d96dd1f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:03.390738 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-40583e97-5fdb-4efe-b6cf-48ebac7dde82 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:03.406047 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-40583e97-5fdb-4efe-b6cf-48ebac7dde82 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.423361 Jul 12 18:29:03.407121 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 237/438] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:02 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:29:03.503808 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-030a8c22-50b6-4a1a-a0b5-c7185d96dd1f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:03.519594 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-030a8c22-50b6-4a1a-a0b5-c7185d96dd1f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:03.519594 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-030a8c22-50b6-4a1a-a0b5-c7185d96dd1f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:03.519594 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-030a8c22-50b6-4a1a-a0b5-c7185d96dd1f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.221948 Jul 12 18:29:03.520101 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 202/439] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:03 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:29:03.865105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1bb1e879-837a-451c-a7c3-c1aae369c1cd tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:03.865930 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1bb1e879-837a-451c-a7c3-c1aae369c1cd tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:03.872694 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bb1e879-837a-451c-a7c3-c1aae369c1cd tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:03.883360 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bb1e879-837a-451c-a7c3-c1aae369c1cd tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:03.883360 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bb1e879-837a-451c-a7c3-c1aae369c1cd tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:03.883360 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bb1e879-837a-451c-a7c3-c1aae369c1cd tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:04.018895 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1bb1e879-837a-451c-a7c3-c1aae369c1cd tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:04.027500 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1bb1e879-837a-451c-a7c3-c1aae369c1cd tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.168608 Jul 12 18:29:04.032661 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 238/440] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:03 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:04.429513 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b214bdf2-d69b-4d22-af5e-e01a5c590165 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:04.430551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b214bdf2-d69b-4d22-af5e-e01a5c590165 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:04.440830 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b214bdf2-d69b-4d22-af5e-e01a5c590165 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:04.445156 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b214bdf2-d69b-4d22-af5e-e01a5c590165 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:04.445156 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b214bdf2-d69b-4d22-af5e-e01a5c590165 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:04.445156 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b214bdf2-d69b-4d22-af5e-e01a5c590165 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:04.536078 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-969fdd35-e1f7-4c33-a48e-341495cff9a8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:04.536716 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-969fdd35-e1f7-4c33-a48e-341495cff9a8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:04.543599 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-969fdd35-e1f7-4c33-a48e-341495cff9a8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:04.544047 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-969fdd35-e1f7-4c33-a48e-341495cff9a8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:04.544841 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-969fdd35-e1f7-4c33-a48e-341495cff9a8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:04.545264 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-969fdd35-e1f7-4c33-a48e-341495cff9a8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:04.549828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:04.627918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b214bdf2-d69b-4d22-af5e-e01a5c590165 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:04.638155 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b214bdf2-d69b-4d22-af5e-e01a5c590165 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.216474 Jul 12 18:29:04.639084 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 203/441] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:04 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:04.714715 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-969fdd35-e1f7-4c33-a48e-341495cff9a8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:04.723018 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-969fdd35-e1f7-4c33-a48e-341495cff9a8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:04.724561 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-969fdd35-e1f7-4c33-a48e-341495cff9a8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:04.725712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-969fdd35-e1f7-4c33-a48e-341495cff9a8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.193931 Jul 12 18:29:04.726266 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 239/442] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:04 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:29:05.041621 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-66c43e93-3ffd-451b-9bce-b6730999bd38 req-d84174d4-1407-477e-9624-0887e2205361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa637fee-4d51-4d79-aed2-ed75805784bf", "name": "network-vif-plugged", "status": "completed", "tag": "2f9bf653-860b-4ebb-ba76-4f6b0284e567"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:29:05.050317 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-66c43e93-3ffd-451b-9bce-b6730999bd38 req-d84174d4-1407-477e-9624-0887e2205361 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:05.050783 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-66c43e93-3ffd-451b-9bce-b6730999bd38 req-d84174d4-1407-477e-9624-0887e2205361 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:05.051233 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-579eb469-09b3-496e-bab6-65af33c53073 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:05.052920 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-579eb469-09b3-496e-bab6-65af33c53073 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:05.062606 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-579eb469-09b3-496e-bab6-65af33c53073 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:05.063322 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-579eb469-09b3-496e-bab6-65af33c53073 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:05.063984 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-66c43e93-3ffd-451b-9bce-b6730999bd38 req-d84174d4-1407-477e-9624-0887e2205361 service nova] Creating event network-vif-plugged:2f9bf653-860b-4ebb-ba76-4f6b0284e567 for instance fa637fee-4d51-4d79-aed2-ed75805784bf on hv-cinder-84488 Jul 12 18:29:05.064631 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-579eb469-09b3-496e-bab6-65af33c53073 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:05.065351 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-579eb469-09b3-496e-bab6-65af33c53073 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:05.069307 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-66c43e93-3ffd-451b-9bce-b6730999bd38 req-d84174d4-1407-477e-9624-0887e2205361 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032055 Jul 12 18:29:05.073074 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 204/443] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:29:05.219089 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-579eb469-09b3-496e-bab6-65af33c53073 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:05.227409 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-579eb469-09b3-496e-bab6-65af33c53073 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.184284 Jul 12 18:29:05.228025 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 240/444] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:05 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:05.405291 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ce3c6ce3-958c-49d7-a1b4-66a522de5a7b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:05.406017 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ce3c6ce3-958c-49d7-a1b4-66a522de5a7b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:05.413542 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce3c6ce3-958c-49d7-a1b4-66a522de5a7b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:05.413985 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce3c6ce3-958c-49d7-a1b4-66a522de5a7b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:05.414764 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce3c6ce3-958c-49d7-a1b4-66a522de5a7b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:05.415192 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce3c6ce3-958c-49d7-a1b4-66a522de5a7b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:05.430875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:05.590442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ce3c6ce3-958c-49d7-a1b4-66a522de5a7b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:05.605896 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ce3c6ce3-958c-49d7-a1b4-66a522de5a7b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1595 microversion: 2.1 time: 0.204253 Jul 12 18:29:05.607214 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 205/445] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:05 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1595 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:05.656855 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5f8ddb12-6938-4c1e-8b39-3304ae5950c2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:05.658178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5f8ddb12-6938-4c1e-8b39-3304ae5950c2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:05.667038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5f8ddb12-6938-4c1e-8b39-3304ae5950c2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:05.668016 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5f8ddb12-6938-4c1e-8b39-3304ae5950c2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:05.669080 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5f8ddb12-6938-4c1e-8b39-3304ae5950c2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:05.669737 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5f8ddb12-6938-4c1e-8b39-3304ae5950c2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:05.746793 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cddad536-8f2d-4546-8268-5b0541dc58ac tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:05.751728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cddad536-8f2d-4546-8268-5b0541dc58ac tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:05.764001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cddad536-8f2d-4546-8268-5b0541dc58ac tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:05.766138 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cddad536-8f2d-4546-8268-5b0541dc58ac tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:05.768806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cddad536-8f2d-4546-8268-5b0541dc58ac tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:05.770383 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cddad536-8f2d-4546-8268-5b0541dc58ac tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:05.837404 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5f8ddb12-6938-4c1e-8b39-3304ae5950c2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:05.846752 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5f8ddb12-6938-4c1e-8b39-3304ae5950c2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.195047 Jul 12 18:29:05.847532 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 241/446] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:05 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:06.070207 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cddad536-8f2d-4546-8268-5b0541dc58ac tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:06.079515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cddad536-8f2d-4546-8268-5b0541dc58ac tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:06.081107 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cddad536-8f2d-4546-8268-5b0541dc58ac tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:06.085792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cddad536-8f2d-4546-8268-5b0541dc58ac tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.339906 Jul 12 18:29:06.085792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 206/447] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:05 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:29:06.245831 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4d0d1f97-a0ff-4f12-82b2-bd5e2a3d7c1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:06.246550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4d0d1f97-a0ff-4f12-82b2-bd5e2a3d7c1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:06.253102 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d0d1f97-a0ff-4f12-82b2-bd5e2a3d7c1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:06.253635 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d0d1f97-a0ff-4f12-82b2-bd5e2a3d7c1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:06.255157 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d0d1f97-a0ff-4f12-82b2-bd5e2a3d7c1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:06.255773 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d0d1f97-a0ff-4f12-82b2-bd5e2a3d7c1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:06.541051 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4d0d1f97-a0ff-4f12-82b2-bd5e2a3d7c1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:06.550325 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4d0d1f97-a0ff-4f12-82b2-bd5e2a3d7c1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.308471 Jul 12 18:29:06.551877 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 242/448] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:06 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:29:06.876710 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-34307c8d-c6b0-4a67-b8aa-d22552c552f4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:06.877445 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-34307c8d-c6b0-4a67-b8aa-d22552c552f4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:06.884139 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-34307c8d-c6b0-4a67-b8aa-d22552c552f4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:06.884636 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-34307c8d-c6b0-4a67-b8aa-d22552c552f4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:06.885403 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-34307c8d-c6b0-4a67-b8aa-d22552c552f4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:06.885826 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-34307c8d-c6b0-4a67-b8aa-d22552c552f4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:07.033544 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-34307c8d-c6b0-4a67-b8aa-d22552c552f4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:07.049119 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-34307c8d-c6b0-4a67-b8aa-d22552c552f4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.175901 Jul 12 18:29:07.050022 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 207/449] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:06 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:07.102715 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-aa9b1fd4-b71e-4ff9-9a41-276803949afd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:07.104157 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-aa9b1fd4-b71e-4ff9-9a41-276803949afd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:07.116160 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aa9b1fd4-b71e-4ff9-9a41-276803949afd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:07.116994 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aa9b1fd4-b71e-4ff9-9a41-276803949afd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:07.118402 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aa9b1fd4-b71e-4ff9-9a41-276803949afd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:07.119191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aa9b1fd4-b71e-4ff9-9a41-276803949afd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:07.356749 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-aa9b1fd4-b71e-4ff9-9a41-276803949afd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:07.367194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-aa9b1fd4-b71e-4ff9-9a41-276803949afd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:07.368825 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-aa9b1fd4-b71e-4ff9-9a41-276803949afd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:07.370003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-aa9b1fd4-b71e-4ff9-9a41-276803949afd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.272782 Jul 12 18:29:07.370567 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 243/450] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:07 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:29:07.571840 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-20611e71-0b9f-4b11-904e-1e3e0842f463 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:07.572551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-20611e71-0b9f-4b11-904e-1e3e0842f463 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:07.579070 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-20611e71-0b9f-4b11-904e-1e3e0842f463 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:07.579522 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-20611e71-0b9f-4b11-904e-1e3e0842f463 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:07.580535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-20611e71-0b9f-4b11-904e-1e3e0842f463 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:07.580971 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-20611e71-0b9f-4b11-904e-1e3e0842f463 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:07.762084 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-20611e71-0b9f-4b11-904e-1e3e0842f463 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:07.770638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-20611e71-0b9f-4b11-904e-1e3e0842f463 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.204028 Jul 12 18:29:07.777146 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 208/451] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:07 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:08.074108 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a29b1215-84ea-4f4a-8005-fbec0b6508ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:08.074879 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a29b1215-84ea-4f4a-8005-fbec0b6508ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:08.082586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a29b1215-84ea-4f4a-8005-fbec0b6508ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:08.083305 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a29b1215-84ea-4f4a-8005-fbec0b6508ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:08.084355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a29b1215-84ea-4f4a-8005-fbec0b6508ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:08.084962 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a29b1215-84ea-4f4a-8005-fbec0b6508ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:08.340827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a29b1215-84ea-4f4a-8005-fbec0b6508ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:08.350695 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a29b1215-84ea-4f4a-8005-fbec0b6508ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.281280 Jul 12 18:29:08.351408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 244/452] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:08 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:08.394365 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e32f50b1-d292-4af4-bb44-8e9be4cf5c86 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:08.395973 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e32f50b1-d292-4af4-bb44-8e9be4cf5c86 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:08.403071 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e32f50b1-d292-4af4-bb44-8e9be4cf5c86 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:08.403507 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e32f50b1-d292-4af4-bb44-8e9be4cf5c86 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:08.404339 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e32f50b1-d292-4af4-bb44-8e9be4cf5c86 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:08.404783 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e32f50b1-d292-4af4-bb44-8e9be4cf5c86 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:08.584844 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e32f50b1-d292-4af4-bb44-8e9be4cf5c86 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:08.604829 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e32f50b1-d292-4af4-bb44-8e9be4cf5c86 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:08.606676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e32f50b1-d292-4af4-bb44-8e9be4cf5c86 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:08.608076 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e32f50b1-d292-4af4-bb44-8e9be4cf5c86 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.218446 Jul 12 18:29:08.609018 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 209/453] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:08 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:29:08.655213 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-f6cc72ed-46ca-41a6-8feb-bd11023b859f req-4e99a94b-e39b-4f82-829c-084380a7ee7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c546fb53-6e12-426c-99a6-e6264514203d", "tag": "6becd9b8-f6f0-4c1e-8ce2-67eb379069f7"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:29:08.671799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-f6cc72ed-46ca-41a6-8feb-bd11023b859f req-4e99a94b-e39b-4f82-829c-084380a7ee7c service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:08.672234 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-f6cc72ed-46ca-41a6-8feb-bd11023b859f req-4e99a94b-e39b-4f82-829c-084380a7ee7c service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:08.690052 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-f6cc72ed-46ca-41a6-8feb-bd11023b859f req-4e99a94b-e39b-4f82-829c-084380a7ee7c service nova] Creating event network-changed:6becd9b8-f6f0-4c1e-8ce2-67eb379069f7 for instance c546fb53-6e12-426c-99a6-e6264514203d on hv-cinder-84488 Jul 12 18:29:08.709117 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-f6cc72ed-46ca-41a6-8feb-bd11023b859f req-4e99a94b-e39b-4f82-829c-084380a7ee7c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060409 Jul 12 18:29:08.709730 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 245/454] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:29:08.795501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-118b753a-4038-467b-b3fc-9962d428a61e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:08.796490 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-118b753a-4038-467b-b3fc-9962d428a61e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:08.807340 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-118b753a-4038-467b-b3fc-9962d428a61e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:08.810899 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-118b753a-4038-467b-b3fc-9962d428a61e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:08.815680 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-118b753a-4038-467b-b3fc-9962d428a61e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:08.815680 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-118b753a-4038-467b-b3fc-9962d428a61e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:09.159906 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-118b753a-4038-467b-b3fc-9962d428a61e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:09.169724 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-118b753a-4038-467b-b3fc-9962d428a61e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.379604 Jul 12 18:29:09.181851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 210/455] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:08 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:09.375991 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-faf3512e-72e0-44f6-8bc0-0487a2d392ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:09.377061 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-faf3512e-72e0-44f6-8bc0-0487a2d392ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:09.386746 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-faf3512e-72e0-44f6-8bc0-0487a2d392ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:09.387600 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-faf3512e-72e0-44f6-8bc0-0487a2d392ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:09.388955 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-faf3512e-72e0-44f6-8bc0-0487a2d392ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:09.389633 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-faf3512e-72e0-44f6-8bc0-0487a2d392ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:09.631151 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0dceb054-1de2-45c6-a115-8c1fdaedf8fd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:09.632543 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0dceb054-1de2-45c6-a115-8c1fdaedf8fd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:09.651962 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0dceb054-1de2-45c6-a115-8c1fdaedf8fd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:09.652866 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0dceb054-1de2-45c6-a115-8c1fdaedf8fd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:09.653852 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0dceb054-1de2-45c6-a115-8c1fdaedf8fd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:09.654704 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0dceb054-1de2-45c6-a115-8c1fdaedf8fd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:09.796832 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-faf3512e-72e0-44f6-8bc0-0487a2d392ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:09.809307 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-faf3512e-72e0-44f6-8bc0-0487a2d392ed tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.440474 Jul 12 18:29:09.811361 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 246/456] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:09 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:29:09.963693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0dceb054-1de2-45c6-a115-8c1fdaedf8fd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:09.976395 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0dceb054-1de2-45c6-a115-8c1fdaedf8fd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:09.978299 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0dceb054-1de2-45c6-a115-8c1fdaedf8fd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:09.980015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0dceb054-1de2-45c6-a115-8c1fdaedf8fd tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1809 microversion: 2.20 time: 0.354414 Jul 12 18:29:09.993113 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 211/457] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:09 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1809 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:29:10.188910 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-480b6a56-5b6d-4f6c-87c6-fd832c9b2024 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:10.196926 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-480b6a56-5b6d-4f6c-87c6-fd832c9b2024 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:10.201368 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-480b6a56-5b6d-4f6c-87c6-fd832c9b2024 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:10.203666 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-480b6a56-5b6d-4f6c-87c6-fd832c9b2024 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:10.204551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-480b6a56-5b6d-4f6c-87c6-fd832c9b2024 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:10.205006 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-480b6a56-5b6d-4f6c-87c6-fd832c9b2024 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:10.436559 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-480b6a56-5b6d-4f6c-87c6-fd832c9b2024 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:10.452766 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-480b6a56-5b6d-4f6c-87c6-fd832c9b2024 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.268357 Jul 12 18:29:10.453614 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 247/458] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:10 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:10.840060 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bc2aae67-04f8-4155-841a-95e776c78788 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:10.854141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bc2aae67-04f8-4155-841a-95e776c78788 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:10.881534 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc2aae67-04f8-4155-841a-95e776c78788 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:10.882417 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc2aae67-04f8-4155-841a-95e776c78788 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:10.883974 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc2aae67-04f8-4155-841a-95e776c78788 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:10.885187 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc2aae67-04f8-4155-841a-95e776c78788 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:11.003885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d7bff31d-c285-4922-ad77-71c732cb2794 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:11.005534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d7bff31d-c285-4922-ad77-71c732cb2794 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:11.043330 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d7bff31d-c285-4922-ad77-71c732cb2794 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:11.044672 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d7bff31d-c285-4922-ad77-71c732cb2794 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:11.045675 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d7bff31d-c285-4922-ad77-71c732cb2794 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:11.046299 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d7bff31d-c285-4922-ad77-71c732cb2794 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:11.101957 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bc2aae67-04f8-4155-841a-95e776c78788 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:11.119028 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bc2aae67-04f8-4155-841a-95e776c78788 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.282796 Jul 12 18:29:11.120682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 212/459] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:10 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:11.239603 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d7bff31d-c285-4922-ad77-71c732cb2794 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:11.250141 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d7bff31d-c285-4922-ad77-71c732cb2794 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:11.251871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d7bff31d-c285-4922-ad77-71c732cb2794 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:11.253080 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d7bff31d-c285-4922-ad77-71c732cb2794 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1796 microversion: 2.20 time: 0.256706 Jul 12 18:29:11.257314 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 248/460] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:10 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1796 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:29:11.472251 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-573dddba-6fbf-4c1e-b316-07069023a0d2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:11.472926 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-573dddba-6fbf-4c1e-b316-07069023a0d2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:11.480159 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-573dddba-6fbf-4c1e-b316-07069023a0d2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:11.480635 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-573dddba-6fbf-4c1e-b316-07069023a0d2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:11.481473 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-573dddba-6fbf-4c1e-b316-07069023a0d2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:11.482070 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-573dddba-6fbf-4c1e-b316-07069023a0d2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:11.627919 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-573dddba-6fbf-4c1e-b316-07069023a0d2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:11.636945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-573dddba-6fbf-4c1e-b316-07069023a0d2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.168619 Jul 12 18:29:11.637529 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 213/461] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:11 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:12.139054 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8b8130ba-1ea3-4812-ae5f-185a2a6e681d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:12.140535 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8b8130ba-1ea3-4812-ae5f-185a2a6e681d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:12.148396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8b8130ba-1ea3-4812-ae5f-185a2a6e681d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:12.148848 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8b8130ba-1ea3-4812-ae5f-185a2a6e681d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:12.149995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8b8130ba-1ea3-4812-ae5f-185a2a6e681d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:12.150622 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8b8130ba-1ea3-4812-ae5f-185a2a6e681d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:12.396985 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8b8130ba-1ea3-4812-ae5f-185a2a6e681d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:12.406702 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8b8130ba-1ea3-4812-ae5f-185a2a6e681d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.271612 Jul 12 18:29:12.418362 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 249/462] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:12 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:12.422693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b418c861-146b-460f-bef7-ff89f62ffc6c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1717293275"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:29:12.427402 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b418c861-146b-460f-bef7-ff89f62ffc6c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:12.435101 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b418c861-146b-460f-bef7-ff89f62ffc6c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:12.435548 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b418c861-146b-460f-bef7-ff89f62ffc6c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:12.436464 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b418c861-146b-460f-bef7-ff89f62ffc6c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:12.436809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b418c861-146b-460f-bef7-ff89f62ffc6c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:12.613073 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.network.security_group_api [None req-b418c861-146b-460f-bef7-ff89f62ffc6c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Adding security group 4fafd82f-3a1c-40b5-b138-8880ed043fe8 to port 6becd9b8-f6f0-4c1e-8ce2-67eb379069f7 Jul 12 18:29:12.655796 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-de9cee8a-738b-434c-9d21-f5eeb2c6b5d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:12.656671 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-de9cee8a-738b-434c-9d21-f5eeb2c6b5d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:12.659700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=74 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:12.666039 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-de9cee8a-738b-434c-9d21-f5eeb2c6b5d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:12.666902 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-de9cee8a-738b-434c-9d21-f5eeb2c6b5d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:12.667602 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-de9cee8a-738b-434c-9d21-f5eeb2c6b5d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:12.668192 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-de9cee8a-738b-434c-9d21-f5eeb2c6b5d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:12.844537 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-de9cee8a-738b-434c-9d21-f5eeb2c6b5d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:12.853251 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-de9cee8a-738b-434c-9d21-f5eeb2c6b5d0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.202608 Jul 12 18:29:12.862827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 250/463] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:12 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:29:13.130937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b418c861-146b-460f-bef7-ff89f62ffc6c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "POST /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/action" status: 202 len: 0 microversion: 2.1 time: 0.714156 Jul 12 18:29:13.131710 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 214/464] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:29:12 2022] POST /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/action => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:29:13.136134 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-4040e840-28cd-4b9b-9d4b-c30f39f3a41a req-530a75dd-ab68-4bf1-9156-a6b96de5bea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c546fb53-6e12-426c-99a6-e6264514203d", "tag": "6becd9b8-f6f0-4c1e-8ce2-67eb379069f7"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:29:13.144141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-dc65a394-0222-4e00-bc44-1671d5ad6a1a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:13.146386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-4040e840-28cd-4b9b-9d4b-c30f39f3a41a req-530a75dd-ab68-4bf1-9156-a6b96de5bea3 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:13.146812 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-4040e840-28cd-4b9b-9d4b-c30f39f3a41a req-530a75dd-ab68-4bf1-9156-a6b96de5bea3 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:13.148447 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-dc65a394-0222-4e00-bc44-1671d5ad6a1a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:13.158476 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-4040e840-28cd-4b9b-9d4b-c30f39f3a41a req-530a75dd-ab68-4bf1-9156-a6b96de5bea3 service nova] Creating event network-changed:6becd9b8-f6f0-4c1e-8ce2-67eb379069f7 for instance c546fb53-6e12-426c-99a6-e6264514203d on hv-cinder-84488 Jul 12 18:29:13.161235 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc65a394-0222-4e00-bc44-1671d5ad6a1a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:13.161998 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc65a394-0222-4e00-bc44-1671d5ad6a1a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:13.163889 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-4040e840-28cd-4b9b-9d4b-c30f39f3a41a req-530a75dd-ab68-4bf1-9156-a6b96de5bea3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031410 Jul 12 18:29:13.164900 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 251/465] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:29:13.170029 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc65a394-0222-4e00-bc44-1671d5ad6a1a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:13.172909 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc65a394-0222-4e00-bc44-1671d5ad6a1a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:13.375972 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dc65a394-0222-4e00-bc44-1671d5ad6a1a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:13.392554 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-dc65a394-0222-4e00-bc44-1671d5ad6a1a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1761 microversion: 2.1 time: 0.254131 Jul 12 18:29:13.393785 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 215/466] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:13 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1761 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:29:13.428522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e5fed6c2-e7a8-4cbd-8dcc-cb287ac196ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:13.429338 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e5fed6c2-e7a8-4cbd-8dcc-cb287ac196ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:13.437386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e5fed6c2-e7a8-4cbd-8dcc-cb287ac196ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:13.437847 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e5fed6c2-e7a8-4cbd-8dcc-cb287ac196ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:13.438655 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e5fed6c2-e7a8-4cbd-8dcc-cb287ac196ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:13.439098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e5fed6c2-e7a8-4cbd-8dcc-cb287ac196ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:13.647847 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e5fed6c2-e7a8-4cbd-8dcc-cb287ac196ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:13.656256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e5fed6c2-e7a8-4cbd-8dcc-cb287ac196ef tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.233958 Jul 12 18:29:13.657122 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 252/467] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:13 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:13.874848 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-73e44d00-96db-47f3-9178-61144739dbeb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:13.875935 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-73e44d00-96db-47f3-9178-61144739dbeb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:13.886697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-73e44d00-96db-47f3-9178-61144739dbeb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:13.887477 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-73e44d00-96db-47f3-9178-61144739dbeb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:13.888892 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-73e44d00-96db-47f3-9178-61144739dbeb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:13.889651 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-73e44d00-96db-47f3-9178-61144739dbeb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:14.058605 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-73e44d00-96db-47f3-9178-61144739dbeb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:14.081516 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-73e44d00-96db-47f3-9178-61144739dbeb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.213757 Jul 12 18:29:14.082199 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 216/468] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:13 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:14.674959 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0faf5a7f-4a20-4cbe-8b0f-2a1ce82fabd7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:14.675581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0faf5a7f-4a20-4cbe-8b0f-2a1ce82fabd7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:14.683089 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0faf5a7f-4a20-4cbe-8b0f-2a1ce82fabd7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:14.683526 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0faf5a7f-4a20-4cbe-8b0f-2a1ce82fabd7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:14.684320 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0faf5a7f-4a20-4cbe-8b0f-2a1ce82fabd7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:14.684833 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0faf5a7f-4a20-4cbe-8b0f-2a1ce82fabd7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:14.833506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0faf5a7f-4a20-4cbe-8b0f-2a1ce82fabd7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:14.842932 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0faf5a7f-4a20-4cbe-8b0f-2a1ce82fabd7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.171696 Jul 12 18:29:14.843531 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 253/469] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:14 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:15.099642 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1f64357d-3dc0-44ba-a625-42761f60b5cb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:15.100251 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1f64357d-3dc0-44ba-a625-42761f60b5cb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:15.107042 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f64357d-3dc0-44ba-a625-42761f60b5cb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:15.107390 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f64357d-3dc0-44ba-a625-42761f60b5cb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:15.108205 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f64357d-3dc0-44ba-a625-42761f60b5cb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:15.108688 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f64357d-3dc0-44ba-a625-42761f60b5cb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:15.260547 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1f64357d-3dc0-44ba-a625-42761f60b5cb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:15.268666 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1f64357d-3dc0-44ba-a625-42761f60b5cb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1676 microversion: 2.1 time: 0.173442 Jul 12 18:29:15.269279 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 217/470] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:15 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:15.867370 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6c030d20-22eb-44da-aa76-7a75bfb82510 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:15.868788 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6c030d20-22eb-44da-aa76-7a75bfb82510 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:15.880114 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6c030d20-22eb-44da-aa76-7a75bfb82510 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:15.885917 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6c030d20-22eb-44da-aa76-7a75bfb82510 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:15.887115 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6c030d20-22eb-44da-aa76-7a75bfb82510 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:15.887763 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6c030d20-22eb-44da-aa76-7a75bfb82510 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:16.105637 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6c030d20-22eb-44da-aa76-7a75bfb82510 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:16.114927 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6c030d20-22eb-44da-aa76-7a75bfb82510 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.256414 Jul 12 18:29:16.115598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 254/471] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:15 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:16.287355 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6246f269-c876-4726-857a-7eba5e6e882d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:16.287959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6246f269-c876-4726-857a-7eba5e6e882d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:16.295041 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6246f269-c876-4726-857a-7eba5e6e882d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:16.295492 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6246f269-c876-4726-857a-7eba5e6e882d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:16.296266 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6246f269-c876-4726-857a-7eba5e6e882d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:16.296726 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6246f269-c876-4726-857a-7eba5e6e882d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:16.669816 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6246f269-c876-4726-857a-7eba5e6e882d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:16.678755 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6246f269-c876-4726-857a-7eba5e6e882d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1653 microversion: 2.1 time: 0.395428 Jul 12 18:29:16.679351 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 218/472] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:16 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1653 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:16.696363 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-48b0e02c-4668-47d3-9e70-2d520b78f619 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:29:16.707089 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-48b0e02c-4668-47d3-9e70-2d520b78f619 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:16.707089 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-48b0e02c-4668-47d3-9e70-2d520b78f619 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:16.729312 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-48b0e02c-4668-47d3-9e70-2d520b78f619 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Going to try to start instance {{(pid=118411) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 18:29:16.974381 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-48b0e02c-4668-47d3-9e70-2d520b78f619 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "POST /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/action" status: 202 len: 0 microversion: 2.1 time: 0.282160 Jul 12 18:29:16.975719 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 255/473] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:29:16 2022] POST /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:29:16.987377 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b092fd9a-31c2-4cc0-ae93-ee90d9d2d3ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:16.987377 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b092fd9a-31c2-4cc0-ae93-ee90d9d2d3ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:16.994728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b092fd9a-31c2-4cc0-ae93-ee90d9d2d3ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:16.995185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b092fd9a-31c2-4cc0-ae93-ee90d9d2d3ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:16.996008 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b092fd9a-31c2-4cc0-ae93-ee90d9d2d3ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:16.996455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b092fd9a-31c2-4cc0-ae93-ee90d9d2d3ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:17.133959 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3bc1edae-282e-45ea-b3d5-cdf0e42fb0a0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:17.134648 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3bc1edae-282e-45ea-b3d5-cdf0e42fb0a0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:17.142055 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3bc1edae-282e-45ea-b3d5-cdf0e42fb0a0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:17.142502 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3bc1edae-282e-45ea-b3d5-cdf0e42fb0a0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:17.143437 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3bc1edae-282e-45ea-b3d5-cdf0e42fb0a0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:17.144048 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3bc1edae-282e-45ea-b3d5-cdf0e42fb0a0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:17.148830 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b092fd9a-31c2-4cc0-ae93-ee90d9d2d3ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:17.151203 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:17.159716 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b092fd9a-31c2-4cc0-ae93-ee90d9d2d3ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1662 microversion: 2.1 time: 0.178476 Jul 12 18:29:17.160301 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 219/474] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:16 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1662 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:17.345002 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3bc1edae-282e-45ea-b3d5-cdf0e42fb0a0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:17.357262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3bc1edae-282e-45ea-b3d5-cdf0e42fb0a0 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.228569 Jul 12 18:29:17.358011 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 256/475] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:17 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:29:18.184323 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-eaeb461a-6d06-41d9-9f0e-733f63599667 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:18.184928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-eaeb461a-6d06-41d9-9f0e-733f63599667 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:18.191729 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eaeb461a-6d06-41d9-9f0e-733f63599667 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:18.192971 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eaeb461a-6d06-41d9-9f0e-733f63599667 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:18.193768 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eaeb461a-6d06-41d9-9f0e-733f63599667 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:18.194322 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eaeb461a-6d06-41d9-9f0e-733f63599667 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:18.347012 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-eaeb461a-6d06-41d9-9f0e-733f63599667 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:18.362544 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-eaeb461a-6d06-41d9-9f0e-733f63599667 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1662 microversion: 2.1 time: 0.181644 Jul 12 18:29:18.363589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 220/476] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:18 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1662 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:18.375646 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9d420907-788e-4d03-a97e-6f02f37dd41f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:18.376443 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9d420907-788e-4d03-a97e-6f02f37dd41f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:18.382744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d420907-788e-4d03-a97e-6f02f37dd41f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:18.383196 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d420907-788e-4d03-a97e-6f02f37dd41f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:18.383966 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d420907-788e-4d03-a97e-6f02f37dd41f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:18.384438 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d420907-788e-4d03-a97e-6f02f37dd41f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:18.522099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9d420907-788e-4d03-a97e-6f02f37dd41f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:18.531026 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9d420907-788e-4d03-a97e-6f02f37dd41f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.159693 Jul 12 18:29:18.531623 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 257/477] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:18 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:19.386213 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b6f489e2-69a9-4220-b2ca-000d6ce7fae1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:19.386838 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b6f489e2-69a9-4220-b2ca-000d6ce7fae1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:19.394828 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6f489e2-69a9-4220-b2ca-000d6ce7fae1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:19.399140 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6f489e2-69a9-4220-b2ca-000d6ce7fae1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:19.399140 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6f489e2-69a9-4220-b2ca-000d6ce7fae1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:19.399140 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6f489e2-69a9-4220-b2ca-000d6ce7fae1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:19.544974 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b6f489e2-69a9-4220-b2ca-000d6ce7fae1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:19.553821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-583389a8-a312-48b6-96de-82bfa0078386 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:19.554412 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b6f489e2-69a9-4220-b2ca-000d6ce7fae1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1666 microversion: 2.1 time: 0.171794 Jul 12 18:29:19.554670 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 221/478] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:19 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1666 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:19.555175 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-583389a8-a312-48b6-96de-82bfa0078386 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:19.566367 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-583389a8-a312-48b6-96de-82bfa0078386 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:19.567793 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-583389a8-a312-48b6-96de-82bfa0078386 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:19.571505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-583389a8-a312-48b6-96de-82bfa0078386 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:19.571505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-583389a8-a312-48b6-96de-82bfa0078386 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:19.729357 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-583389a8-a312-48b6-96de-82bfa0078386 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:19.737838 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-583389a8-a312-48b6-96de-82bfa0078386 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.191884 Jul 12 18:29:19.738414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 258/479] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:19 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:29:20.755797 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ae35f75e-e51f-427a-9766-dbc261fac56e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:20.756486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ae35f75e-e51f-427a-9766-dbc261fac56e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:20.764115 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ae35f75e-e51f-427a-9766-dbc261fac56e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:20.765065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ae35f75e-e51f-427a-9766-dbc261fac56e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:20.765553 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ae35f75e-e51f-427a-9766-dbc261fac56e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:20.767083 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ae35f75e-e51f-427a-9766-dbc261fac56e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:20.781909 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:20.908543 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ae35f75e-e51f-427a-9766-dbc261fac56e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:20.914292 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ae35f75e-e51f-427a-9766-dbc261fac56e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.163021 Jul 12 18:29:20.915145 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 222/480] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:20 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:21.931856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a0630663-d647-4b91-bee4-d28e2d0d67db tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:21.932508 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a0630663-d647-4b91-bee4-d28e2d0d67db tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:21.938779 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a0630663-d647-4b91-bee4-d28e2d0d67db tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:21.939227 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a0630663-d647-4b91-bee4-d28e2d0d67db tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:21.939995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a0630663-d647-4b91-bee4-d28e2d0d67db tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:21.940749 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a0630663-d647-4b91-bee4-d28e2d0d67db tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:22.111621 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a0630663-d647-4b91-bee4-d28e2d0d67db tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:22.125243 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a0630663-d647-4b91-bee4-d28e2d0d67db tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.197037 Jul 12 18:29:22.126448 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 259/481] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:21 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:23.145008 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-281a0308-772f-41ac-9970-9d2c9e74e490 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:23.146494 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-281a0308-772f-41ac-9970-9d2c9e74e490 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:23.154588 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-281a0308-772f-41ac-9970-9d2c9e74e490 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:23.155128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-281a0308-772f-41ac-9970-9d2c9e74e490 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:23.155942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-281a0308-772f-41ac-9970-9d2c9e74e490 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:23.156401 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-281a0308-772f-41ac-9970-9d2c9e74e490 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:23.325793 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-281a0308-772f-41ac-9970-9d2c9e74e490 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:23.333899 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-281a0308-772f-41ac-9970-9d2c9e74e490 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.193794 Jul 12 18:29:23.334488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 223/482] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:23 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:24.351576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-637eb125-0c87-4fe6-be7c-3038f729062f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:24.352143 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-637eb125-0c87-4fe6-be7c-3038f729062f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:24.358345 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-637eb125-0c87-4fe6-be7c-3038f729062f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:24.358791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-637eb125-0c87-4fe6-be7c-3038f729062f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:24.359567 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-637eb125-0c87-4fe6-be7c-3038f729062f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:24.360004 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-637eb125-0c87-4fe6-be7c-3038f729062f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:24.492571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-637eb125-0c87-4fe6-be7c-3038f729062f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:24.500607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-637eb125-0c87-4fe6-be7c-3038f729062f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.153484 Jul 12 18:29:24.501172 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 260/483] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:24 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:25.518744 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4e5e74a1-f24d-4731-bfc6-1af045415871 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:25.519321 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4e5e74a1-f24d-4731-bfc6-1af045415871 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:25.526340 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e5e74a1-f24d-4731-bfc6-1af045415871 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:25.526787 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e5e74a1-f24d-4731-bfc6-1af045415871 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:25.527661 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e5e74a1-f24d-4731-bfc6-1af045415871 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:25.528123 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e5e74a1-f24d-4731-bfc6-1af045415871 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:25.672740 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4e5e74a1-f24d-4731-bfc6-1af045415871 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:25.681939 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4e5e74a1-f24d-4731-bfc6-1af045415871 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1735 microversion: 2.1 time: 0.167198 Jul 12 18:29:25.682531 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 224/484] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:25 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:26.700194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9a13d045-c0f4-4e52-bb71-d7d72d175f7f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:26.700792 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9a13d045-c0f4-4e52-bb71-d7d72d175f7f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:26.706829 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9a13d045-c0f4-4e52-bb71-d7d72d175f7f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:26.707276 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9a13d045-c0f4-4e52-bb71-d7d72d175f7f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:26.708815 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9a13d045-c0f4-4e52-bb71-d7d72d175f7f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:26.709203 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9a13d045-c0f4-4e52-bb71-d7d72d175f7f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:26.841132 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9a13d045-c0f4-4e52-bb71-d7d72d175f7f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:26.849937 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9a13d045-c0f4-4e52-bb71-d7d72d175f7f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1715 microversion: 2.1 time: 0.153599 Jul 12 18:29:26.850503 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 261/485] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:26 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:26.959322 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0ba72b3e-a467-4d13-ab3f-72914881418f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:26.960237 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0ba72b3e-a467-4d13-ab3f-72914881418f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:26.966817 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ba72b3e-a467-4d13-ab3f-72914881418f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:26.967263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ba72b3e-a467-4d13-ab3f-72914881418f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:26.968082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ba72b3e-a467-4d13-ab3f-72914881418f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:26.968546 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ba72b3e-a467-4d13-ab3f-72914881418f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:27.095821 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-0ba72b3e-a467-4d13-ab3f-72914881418f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] HTTP exception thrown: Cannot 'detach_volume' instance f7062eaf-78a1-4879-9edb-6465141472bc while it is in vm_state rescued Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0ba72b3e-a467-4d13-ab3f-72914881418f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Request method failure captured: Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments/b167d5c7-cabd-4576-94f0-a6d4425fd038 HTTP/1.1 Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyL2WKceURQ3_ZkcC34Y0vnD-EGZVufCOFoKfl5xwD31kyWdLgUpvuGYIxbubmz0iOJIC4WFMxdHlep46gbhJgbTsNl3Yq4j2YqV9D8D_aI8PsDZQzyyWWsp3nGlRU1OVMHS9knyY1Zte5rKZdgNY1SWcmoFoIT8GbV17VwJP8_ZwY Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 54167aa5315d4dd2b514ad4b027634f9 Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:29:27.101922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:29:27.103749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_54167aa5315d4dd2b514ad4b027634f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:29:27.103749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:29:27.103749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 54167aa5315d4dd2b514ad4b027634f9 Jul 12 18:29:27.103749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:29:27.103749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-ServerRescueNegativeTestJSON-1109686293-project Jul 12 18:29:27.103749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:29:27.103749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:29:27.103749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: b58b0d520aa1418bb6ad3b5645a826a7 Jul 12 18:29:27.103749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1109686293-project Jul 12 18:29:27.103749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:29:27.103749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Cannot 'detach_volume' instance f7062eaf-78a1-4879-9edb-6465141472bc while it is in vm_state rescued Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'server_id': 'f7062eaf-78a1-4879-9edb-6465141472bc', 'id': 'b167d5c7-cabd-4576-94f0-a6d4425fd038'} Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f7062eaf-78a1-4879-9edb-6465141472bc in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:29:27.104497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f7062eaf-78a1-4879-9edb-6465141472bc while it is in vm_state rescued Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f7062eaf-78a1-4879-9edb-6465141472bc while it is in vm_state rescued Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:29:27.105794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0ba72b3e-a467-4d13-ab3f-72914881418f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Returning 409 to user: Cannot 'detach_volume' instance f7062eaf-78a1-4879-9edb-6465141472bc while it is in vm_state rescued {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:29:27.106961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0ba72b3e-a467-4d13-ab3f-72914881418f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments/b167d5c7-cabd-4576-94f0-a6d4425fd038" status: 409 len: 152 microversion: 2.1 time: 0.144545 Jul 12 18:29:27.106961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 225/486] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:29:26 2022] DELETE /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments/b167d5c7-cabd-4576-94f0-a6d4425fd038 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 18:29:27.108814 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-473db7a0-c010-4a48-aa50-43ed845140f7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:29:27.109366 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-473db7a0-c010-4a48-aa50-43ed845140f7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:27.117123 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-473db7a0-c010-4a48-aa50-43ed845140f7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:27.117599 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-473db7a0-c010-4a48-aa50-43ed845140f7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:27.118430 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-473db7a0-c010-4a48-aa50-43ed845140f7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:27.118861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-473db7a0-c010-4a48-aa50-43ed845140f7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:27.323364 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-473db7a0-c010-4a48-aa50-43ed845140f7 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "POST /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/action" status: 202 len: 0 microversion: 2.1 time: 0.218647 Jul 12 18:29:27.324486 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 262/487] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:29:27 2022] POST /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:29:27.333620 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-eea26512-45bd-4cee-931e-df7afc00f314 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:27.334314 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-eea26512-45bd-4cee-931e-df7afc00f314 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:27.342856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eea26512-45bd-4cee-931e-df7afc00f314 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:27.343306 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eea26512-45bd-4cee-931e-df7afc00f314 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:27.344080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eea26512-45bd-4cee-931e-df7afc00f314 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:27.344535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eea26512-45bd-4cee-931e-df7afc00f314 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:27.543921 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-eea26512-45bd-4cee-931e-df7afc00f314 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:27.554376 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-eea26512-45bd-4cee-931e-df7afc00f314 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1723 microversion: 2.1 time: 0.224814 Jul 12 18:29:27.554801 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 226/488] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:27 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:28.572018 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f8ea1508-b1bb-48e3-90df-af3a399d1024 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:28.572871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f8ea1508-b1bb-48e3-90df-af3a399d1024 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:28.579340 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8ea1508-b1bb-48e3-90df-af3a399d1024 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:28.579783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8ea1508-b1bb-48e3-90df-af3a399d1024 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:28.580570 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8ea1508-b1bb-48e3-90df-af3a399d1024 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:28.581000 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8ea1508-b1bb-48e3-90df-af3a399d1024 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:28.716687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f8ea1508-b1bb-48e3-90df-af3a399d1024 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:28.725348 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f8ea1508-b1bb-48e3-90df-af3a399d1024 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1723 microversion: 2.1 time: 0.157645 Jul 12 18:29:28.725922 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 263/489] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:28 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:29.743234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0bee7718-6afc-4ee2-b9eb-03af0882db37 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:29.743803 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0bee7718-6afc-4ee2-b9eb-03af0882db37 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:29.746221 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=64 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:29.751041 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0bee7718-6afc-4ee2-b9eb-03af0882db37 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:29.751473 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0bee7718-6afc-4ee2-b9eb-03af0882db37 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:29.752222 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0bee7718-6afc-4ee2-b9eb-03af0882db37 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:29.752692 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0bee7718-6afc-4ee2-b9eb-03af0882db37 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:29.882967 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0bee7718-6afc-4ee2-b9eb-03af0882db37 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:29.891048 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0bee7718-6afc-4ee2-b9eb-03af0882db37 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1723 microversion: 2.1 time: 0.152074 Jul 12 18:29:29.891613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 227/490] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:29 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:30.909022 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-00fcf363-1b49-4d00-8f66-e845bfe75cb3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:30.909625 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-00fcf363-1b49-4d00-8f66-e845bfe75cb3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:30.916399 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-00fcf363-1b49-4d00-8f66-e845bfe75cb3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:30.916849 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-00fcf363-1b49-4d00-8f66-e845bfe75cb3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:30.917624 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-00fcf363-1b49-4d00-8f66-e845bfe75cb3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:30.918067 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-00fcf363-1b49-4d00-8f66-e845bfe75cb3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:31.050760 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-00fcf363-1b49-4d00-8f66-e845bfe75cb3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:31.058912 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-00fcf363-1b49-4d00-8f66-e845bfe75cb3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1729 microversion: 2.1 time: 0.153677 Jul 12 18:29:31.059483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 264/491] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:30 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:31.075911 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1b808f05-8af9-41bc-a8f1-de6cf24bc8ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:31.076522 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1b808f05-8af9-41bc-a8f1-de6cf24bc8ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:31.083834 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b808f05-8af9-41bc-a8f1-de6cf24bc8ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:31.084272 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b808f05-8af9-41bc-a8f1-de6cf24bc8ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:31.085062 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b808f05-8af9-41bc-a8f1-de6cf24bc8ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:31.085517 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b808f05-8af9-41bc-a8f1-de6cf24bc8ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:31.162344 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1b808f05-8af9-41bc-a8f1-de6cf24bc8ec tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090262 Jul 12 18:29:31.162962 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 228/492] 10.222.0.47 () {58 vars in 1274 bytes} [Tue Jul 12 18:29:31 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:29:32.540032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-256195c0-51b0-4bf7-86f2-6d6a08f6d9c2 req-1ab9856c-2725-4ab6-8cd5-5cfcb473c449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7062eaf-78a1-4879-9edb-6465141472bc", "tag": "481a00ce-3877-4a82-887d-6774ec1254f9"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:29:32.548353 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-256195c0-51b0-4bf7-86f2-6d6a08f6d9c2 req-1ab9856c-2725-4ab6-8cd5-5cfcb473c449 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:32.549056 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-256195c0-51b0-4bf7-86f2-6d6a08f6d9c2 req-1ab9856c-2725-4ab6-8cd5-5cfcb473c449 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:32.561456 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-256195c0-51b0-4bf7-86f2-6d6a08f6d9c2 req-1ab9856c-2725-4ab6-8cd5-5cfcb473c449 service nova] Creating event network-changed:481a00ce-3877-4a82-887d-6774ec1254f9 for instance f7062eaf-78a1-4879-9edb-6465141472bc on hv-cinder-84488 Jul 12 18:29:32.566338 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-256195c0-51b0-4bf7-86f2-6d6a08f6d9c2 req-1ab9856c-2725-4ab6-8cd5-5cfcb473c449 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030907 Jul 12 18:29:32.567587 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 265/493] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:29:34.581209 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-1fe618f0-5499-4419-a1aa-ed0ec7dc28b7 req-f3bc2d7f-a682-4203-88c5-4c1ecfe6e618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7062eaf-78a1-4879-9edb-6465141472bc", "tag": "481a00ce-3877-4a82-887d-6774ec1254f9"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:29:34.590053 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-1fe618f0-5499-4419-a1aa-ed0ec7dc28b7 req-f3bc2d7f-a682-4203-88c5-4c1ecfe6e618 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:34.590484 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-1fe618f0-5499-4419-a1aa-ed0ec7dc28b7 req-f3bc2d7f-a682-4203-88c5-4c1ecfe6e618 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:34.604540 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-1fe618f0-5499-4419-a1aa-ed0ec7dc28b7 req-f3bc2d7f-a682-4203-88c5-4c1ecfe6e618 service nova] Creating event network-changed:481a00ce-3877-4a82-887d-6774ec1254f9 for instance f7062eaf-78a1-4879-9edb-6465141472bc on hv-cinder-84488 Jul 12 18:29:34.609471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-1fe618f0-5499-4419-a1aa-ed0ec7dc28b7 req-f3bc2d7f-a682-4203-88c5-4c1ecfe6e618 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032368 Jul 12 18:29:34.610117 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 229/494] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:29:40.527633 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5480c78b-f905-4921-a3e8-1660c504d5a4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:29:40.528699 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5480c78b-f905-4921-a3e8-1660c504d5a4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:40.535060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5480c78b-f905-4921-a3e8-1660c504d5a4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:40.535511 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5480c78b-f905-4921-a3e8-1660c504d5a4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:40.536995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5480c78b-f905-4921-a3e8-1660c504d5a4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:40.537436 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5480c78b-f905-4921-a3e8-1660c504d5a4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:40.760768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5480c78b-f905-4921-a3e8-1660c504d5a4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "POST /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/action" status: 202 len: 0 microversion: 2.1 time: 0.237360 Jul 12 18:29:40.761418 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 266/495] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:29:40 2022] POST /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:29:40.771469 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4f5f7ea8-d653-4126-8234-88d1d6f8e031 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:40.772162 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4f5f7ea8-d653-4126-8234-88d1d6f8e031 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:40.778351 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f5f7ea8-d653-4126-8234-88d1d6f8e031 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:40.778811 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f5f7ea8-d653-4126-8234-88d1d6f8e031 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:40.779567 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f5f7ea8-d653-4126-8234-88d1d6f8e031 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:40.780107 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f5f7ea8-d653-4126-8234-88d1d6f8e031 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:40.968894 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4f5f7ea8-d653-4126-8234-88d1d6f8e031 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:40.977526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4f5f7ea8-d653-4126-8234-88d1d6f8e031 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1753 microversion: 2.1 time: 0.211666 Jul 12 18:29:40.978099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 230/496] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:40 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1753 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:41.996371 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-165df1cb-4607-4c4e-9042-48ed32abf325 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:41.997066 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-165df1cb-4607-4c4e-9042-48ed32abf325 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:42.003370 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-165df1cb-4607-4c4e-9042-48ed32abf325 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:42.003813 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-165df1cb-4607-4c4e-9042-48ed32abf325 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:42.005250 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-165df1cb-4607-4c4e-9042-48ed32abf325 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:42.005687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-165df1cb-4607-4c4e-9042-48ed32abf325 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:42.147854 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-165df1cb-4607-4c4e-9042-48ed32abf325 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:42.155794 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-165df1cb-4607-4c4e-9042-48ed32abf325 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.163653 Jul 12 18:29:42.156371 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 267/497] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:41 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:43.173768 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e8b24c00-657d-4e68-8724-8f3ed515e7e3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:43.174366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e8b24c00-657d-4e68-8724-8f3ed515e7e3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:43.181669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e8b24c00-657d-4e68-8724-8f3ed515e7e3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:43.182110 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e8b24c00-657d-4e68-8724-8f3ed515e7e3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:43.182862 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e8b24c00-657d-4e68-8724-8f3ed515e7e3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:43.183285 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e8b24c00-657d-4e68-8724-8f3ed515e7e3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:43.326683 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e8b24c00-657d-4e68-8724-8f3ed515e7e3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:43.335922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e8b24c00-657d-4e68-8724-8f3ed515e7e3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.166038 Jul 12 18:29:43.336448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 231/498] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:43 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:44.353547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-81b553e2-1d82-472f-b430-49198802c764 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:44.354138 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-81b553e2-1d82-472f-b430-49198802c764 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:44.356283 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=36 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:44.361272 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81b553e2-1d82-472f-b430-49198802c764 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:44.361714 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81b553e2-1d82-472f-b430-49198802c764 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:44.362467 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81b553e2-1d82-472f-b430-49198802c764 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:44.362900 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81b553e2-1d82-472f-b430-49198802c764 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:44.509357 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-81b553e2-1d82-472f-b430-49198802c764 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:44.517170 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-81b553e2-1d82-472f-b430-49198802c764 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.167488 Jul 12 18:29:44.517727 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 268/499] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:44 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:45.534315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-296bb98a-4f61-45b3-9acf-22f20361e54b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:45.534907 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-296bb98a-4f61-45b3-9acf-22f20361e54b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:45.541456 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-296bb98a-4f61-45b3-9acf-22f20361e54b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:45.541893 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-296bb98a-4f61-45b3-9acf-22f20361e54b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:45.542643 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-296bb98a-4f61-45b3-9acf-22f20361e54b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:45.543065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-296bb98a-4f61-45b3-9acf-22f20361e54b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:45.693141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-296bb98a-4f61-45b3-9acf-22f20361e54b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:45.701388 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-296bb98a-4f61-45b3-9acf-22f20361e54b tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.170824 Jul 12 18:29:45.701900 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 232/500] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:45 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:46.719013 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8ecb63f6-e5d3-4133-83ea-12616e925fe0 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:46.719771 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8ecb63f6-e5d3-4133-83ea-12616e925fe0 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:46.725897 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8ecb63f6-e5d3-4133-83ea-12616e925fe0 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:46.726335 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8ecb63f6-e5d3-4133-83ea-12616e925fe0 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:46.727092 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8ecb63f6-e5d3-4133-83ea-12616e925fe0 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:46.727520 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8ecb63f6-e5d3-4133-83ea-12616e925fe0 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:46.875006 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8ecb63f6-e5d3-4133-83ea-12616e925fe0 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:46.883997 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8ecb63f6-e5d3-4133-83ea-12616e925fe0 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.168718 Jul 12 18:29:46.884632 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 269/501] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:46 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:47.901751 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-45a398c8-aa49-4d7a-aa58-3955415c4e61 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:47.902363 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-45a398c8-aa49-4d7a-aa58-3955415c4e61 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:47.908975 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45a398c8-aa49-4d7a-aa58-3955415c4e61 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:47.909418 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45a398c8-aa49-4d7a-aa58-3955415c4e61 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:47.910180 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45a398c8-aa49-4d7a-aa58-3955415c4e61 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:47.911145 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45a398c8-aa49-4d7a-aa58-3955415c4e61 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:48.057028 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-45a398c8-aa49-4d7a-aa58-3955415c4e61 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:48.065060 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-45a398c8-aa49-4d7a-aa58-3955415c4e61 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.167215 Jul 12 18:29:48.065633 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 233/502] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:47 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:49.083377 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a9c94750-5e4f-4ec6-abb4-c15b778eb4e9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:49.083933 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a9c94750-5e4f-4ec6-abb4-c15b778eb4e9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:49.090104 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a9c94750-5e4f-4ec6-abb4-c15b778eb4e9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:49.090586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a9c94750-5e4f-4ec6-abb4-c15b778eb4e9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:49.091360 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a9c94750-5e4f-4ec6-abb4-c15b778eb4e9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:49.091808 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a9c94750-5e4f-4ec6-abb4-c15b778eb4e9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:49.094507 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:49.241398 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a9c94750-5e4f-4ec6-abb4-c15b778eb4e9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:49.249475 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a9c94750-5e4f-4ec6-abb4-c15b778eb4e9 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.170708 Jul 12 18:29:49.250049 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 270/503] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:49 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:49.853618 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-70f4f48b-d9b4-418a-9d4b-0b45f7a9b10a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:49.854302 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-70f4f48b-d9b4-418a-9d4b-0b45f7a9b10a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:49.860793 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70f4f48b-d9b4-418a-9d4b-0b45f7a9b10a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:49.861483 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70f4f48b-d9b4-418a-9d4b-0b45f7a9b10a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:49.862245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70f4f48b-d9b4-418a-9d4b-0b45f7a9b10a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:49.862665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70f4f48b-d9b4-418a-9d4b-0b45f7a9b10a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:49.892659 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-70f4f48b-d9b4-418a-9d4b-0b45f7a9b10a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments/8ecc210c-1368-4b8c-a6f5-63d0bb0333fc" status: 200 len: 194 microversion: 2.20 time: 0.044095 Jul 12 18:29:49.893248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 234/504] 10.222.0.47 () {60 vars in 1453 bytes} [Tue Jul 12 18:29:49 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments/8ecc210c-1368-4b8c-a6f5-63d0bb0333fc => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:29:49.960003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ecba3147-f4ff-48c8-b78a-93411abb8de8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:49.960539 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ecba3147-f4ff-48c8-b78a-93411abb8de8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:49.966532 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ecba3147-f4ff-48c8-b78a-93411abb8de8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:49.968744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ecba3147-f4ff-48c8-b78a-93411abb8de8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:49.968744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ecba3147-f4ff-48c8-b78a-93411abb8de8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:49.968744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ecba3147-f4ff-48c8-b78a-93411abb8de8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:50.050189 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-ecba3147-f4ff-48c8-b78a-93411abb8de8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lazy-loading 'services' on Instance uuid fa637fee-4d51-4d79-aed2-ed75805784bf {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:29:50.266952 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9592c761-503f-4db9-9e8d-4cdd3ed4f7c4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:50.267552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9592c761-503f-4db9-9e8d-4cdd3ed4f7c4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:50.271572 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ecba3147-f4ff-48c8-b78a-93411abb8de8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments/8ecc210c-1368-4b8c-a6f5-63d0bb0333fc" status: 202 len: 0 microversion: 2.20 time: 0.314969 Jul 12 18:29:50.275588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 271/505] 10.222.0.47 () {60 vars in 1456 bytes} [Tue Jul 12 18:29:49 2022] DELETE /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments/8ecc210c-1368-4b8c-a6f5-63d0bb0333fc => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:29:50.277639 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9592c761-503f-4db9-9e8d-4cdd3ed4f7c4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:50.278568 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9592c761-503f-4db9-9e8d-4cdd3ed4f7c4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:50.279855 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9592c761-503f-4db9-9e8d-4cdd3ed4f7c4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:50.280606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9592c761-503f-4db9-9e8d-4cdd3ed4f7c4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:50.285158 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-53390ce9-b967-4de0-ae1a-526700d616ed tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:50.287537 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-53390ce9-b967-4de0-ae1a-526700d616ed tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:50.296733 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53390ce9-b967-4de0-ae1a-526700d616ed tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:50.297445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53390ce9-b967-4de0-ae1a-526700d616ed tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:50.298651 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53390ce9-b967-4de0-ae1a-526700d616ed tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:50.299370 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53390ce9-b967-4de0-ae1a-526700d616ed tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:50.344431 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-53390ce9-b967-4de0-ae1a-526700d616ed tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066960 Jul 12 18:29:50.345017 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 272/506] 10.222.0.47 () {60 vars in 1342 bytes} [Tue Jul 12 18:29:50 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:29:50.455018 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9592c761-503f-4db9-9e8d-4cdd3ed4f7c4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:50.463800 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9592c761-503f-4db9-9e8d-4cdd3ed4f7c4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.200707 Jul 12 18:29:50.464381 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 235/507] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:50 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:29:51.356524 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0697a013-9603-4a09-a235-054bbecb4c7b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:51.357432 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0697a013-9603-4a09-a235-054bbecb4c7b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:51.363825 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0697a013-9603-4a09-a235-054bbecb4c7b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:51.364401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0697a013-9603-4a09-a235-054bbecb4c7b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:51.365173 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0697a013-9603-4a09-a235-054bbecb4c7b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:51.365607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0697a013-9603-4a09-a235-054bbecb4c7b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:51.396635 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0697a013-9603-4a09-a235-054bbecb4c7b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044061 Jul 12 18:29:51.397209 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 273/508] 10.222.0.47 () {60 vars in 1342 bytes} [Tue Jul 12 18:29:51 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:29:51.481960 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bdbe6f58-7d57-4e08-9413-baa1463bcf86 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:51.482807 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bdbe6f58-7d57-4e08-9413-baa1463bcf86 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:51.490936 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bdbe6f58-7d57-4e08-9413-baa1463bcf86 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:51.491423 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bdbe6f58-7d57-4e08-9413-baa1463bcf86 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:51.492211 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bdbe6f58-7d57-4e08-9413-baa1463bcf86 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:51.492883 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bdbe6f58-7d57-4e08-9413-baa1463bcf86 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:51.497767 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=76 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:51.641778 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bdbe6f58-7d57-4e08-9413-baa1463bcf86 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:51.650560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bdbe6f58-7d57-4e08-9413-baa1463bcf86 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.172823 Jul 12 18:29:51.651061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 236/509] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:51 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:52.408677 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9e0a6dec-d2c9-4309-a8c8-fa13ca32ea9e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:52.409587 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9e0a6dec-d2c9-4309-a8c8-fa13ca32ea9e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:52.416657 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9e0a6dec-d2c9-4309-a8c8-fa13ca32ea9e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:52.417101 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9e0a6dec-d2c9-4309-a8c8-fa13ca32ea9e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:52.417879 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9e0a6dec-d2c9-4309-a8c8-fa13ca32ea9e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:52.418313 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9e0a6dec-d2c9-4309-a8c8-fa13ca32ea9e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:52.448496 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9e0a6dec-d2c9-4309-a8c8-fa13ca32ea9e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043203 Jul 12 18:29:52.448779 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 274/510] 10.222.0.47 () {60 vars in 1342 bytes} [Tue Jul 12 18:29:52 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:52.508740 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-011541f0-5a3f-4daa-a1ea-1f7eada930e6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:52.509290 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-011541f0-5a3f-4daa-a1ea-1f7eada930e6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:52.515868 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-011541f0-5a3f-4daa-a1ea-1f7eada930e6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:52.516325 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-011541f0-5a3f-4daa-a1ea-1f7eada930e6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:52.517114 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-011541f0-5a3f-4daa-a1ea-1f7eada930e6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:52.517547 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-011541f0-5a3f-4daa-a1ea-1f7eada930e6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:52.544972 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-011541f0-5a3f-4daa-a1ea-1f7eada930e6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:29:52.667928 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ac67aa95-e85b-4356-af8a-1a27afa002b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:52.668522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ac67aa95-e85b-4356-af8a-1a27afa002b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:52.674486 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac67aa95-e85b-4356-af8a-1a27afa002b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:52.674924 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac67aa95-e85b-4356-af8a-1a27afa002b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:52.675673 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac67aa95-e85b-4356-af8a-1a27afa002b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:52.676094 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac67aa95-e85b-4356-af8a-1a27afa002b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:52.820922 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ac67aa95-e85b-4356-af8a-1a27afa002b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:52.829162 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ac67aa95-e85b-4356-af8a-1a27afa002b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.165082 Jul 12 18:29:52.829806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 275/511] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:52 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:29:52.847985 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-011541f0-5a3f-4daa-a1ea-1f7eada930e6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 204 len: 0 microversion: 2.20 time: 0.343720 Jul 12 18:29:52.848771 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 237/512] 10.222.0.47 () {60 vars in 1279 bytes} [Tue Jul 12 18:29:52 2022] DELETE /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 18:29:52.857184 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3ee60995-7907-4faa-a110-c978bf8cd87f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:52.858034 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3ee60995-7907-4faa-a110-c978bf8cd87f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:52.864271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3ee60995-7907-4faa-a110-c978bf8cd87f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:52.864756 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3ee60995-7907-4faa-a110-c978bf8cd87f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:52.865543 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3ee60995-7907-4faa-a110-c978bf8cd87f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:52.865980 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3ee60995-7907-4faa-a110-c978bf8cd87f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:53.210903 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3ee60995-7907-4faa-a110-c978bf8cd87f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:53.218894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3ee60995-7907-4faa-a110-c978bf8cd87f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:53.220441 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3ee60995-7907-4faa-a110-c978bf8cd87f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:53.221599 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3ee60995-7907-4faa-a110-c978bf8cd87f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.368459 Jul 12 18:29:53.222169 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 276/513] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:52 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:29:53.847884 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cebef841-1818-4dee-aa7c-ca60d9aae3b6 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:53.848645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cebef841-1818-4dee-aa7c-ca60d9aae3b6 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:53.855301 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cebef841-1818-4dee-aa7c-ca60d9aae3b6 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:53.855745 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cebef841-1818-4dee-aa7c-ca60d9aae3b6 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:53.856531 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cebef841-1818-4dee-aa7c-ca60d9aae3b6 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:53.856963 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cebef841-1818-4dee-aa7c-ca60d9aae3b6 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:54.005995 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cebef841-1818-4dee-aa7c-ca60d9aae3b6 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:54.013991 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cebef841-1818-4dee-aa7c-ca60d9aae3b6 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.170315 Jul 12 18:29:54.014550 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 238/514] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:53 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:54.242243 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-332043f2-bc70-4216-834e-4bab33394ea0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:54.242916 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-332043f2-bc70-4216-834e-4bab33394ea0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:54.248996 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-332043f2-bc70-4216-834e-4bab33394ea0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:54.249439 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-332043f2-bc70-4216-834e-4bab33394ea0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:54.250182 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-332043f2-bc70-4216-834e-4bab33394ea0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:54.250664 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-332043f2-bc70-4216-834e-4bab33394ea0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:54.382076 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-332043f2-bc70-4216-834e-4bab33394ea0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:54.390043 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-332043f2-bc70-4216-834e-4bab33394ea0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:54.391528 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-332043f2-bc70-4216-834e-4bab33394ea0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:54.392690 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-332043f2-bc70-4216-834e-4bab33394ea0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1724 microversion: 2.20 time: 0.155038 Jul 12 18:29:54.393242 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 277/515] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:54 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:29:55.031050 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-576863bc-be8f-479b-b9da-fe86dccfcdd1 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:55.031606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-576863bc-be8f-479b-b9da-fe86dccfcdd1 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:55.039464 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-576863bc-be8f-479b-b9da-fe86dccfcdd1 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:55.039906 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-576863bc-be8f-479b-b9da-fe86dccfcdd1 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:55.040714 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-576863bc-be8f-479b-b9da-fe86dccfcdd1 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:55.041151 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-576863bc-be8f-479b-b9da-fe86dccfcdd1 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:55.281412 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-576863bc-be8f-479b-b9da-fe86dccfcdd1 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:55.291468 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-576863bc-be8f-479b-b9da-fe86dccfcdd1 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.263752 Jul 12 18:29:55.291468 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 239/516] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:55 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:55.413995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e09189c2-e0a7-4501-b759-7725a0b1a416 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:55.417566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e09189c2-e0a7-4501-b759-7725a0b1a416 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:55.420958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e09189c2-e0a7-4501-b759-7725a0b1a416 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:55.421445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e09189c2-e0a7-4501-b759-7725a0b1a416 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:55.422180 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e09189c2-e0a7-4501-b759-7725a0b1a416 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:55.422610 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e09189c2-e0a7-4501-b759-7725a0b1a416 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:55.499347 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e09189c2-e0a7-4501-b759-7725a0b1a416 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:55.508411 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e09189c2-e0a7-4501-b759-7725a0b1a416 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:55.510211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e09189c2-e0a7-4501-b759-7725a0b1a416 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:55.511384 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e09189c2-e0a7-4501-b759-7725a0b1a416 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1656 microversion: 2.20 time: 0.103031 Jul 12 18:29:55.511941 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 278/517] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:55 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1656 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:29:55.720762 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-1d8d0302-fe41-4637-93eb-62628411077d req-440c72c6-8815-460c-b4f8-de6cc8ae6460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa637fee-4d51-4d79-aed2-ed75805784bf", "name": "network-vif-deleted", "tag": "2f9bf653-860b-4ebb-ba76-4f6b0284e567"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:29:55.730865 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-1d8d0302-fe41-4637-93eb-62628411077d req-440c72c6-8815-460c-b4f8-de6cc8ae6460 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:55.732378 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-1d8d0302-fe41-4637-93eb-62628411077d req-440c72c6-8815-460c-b4f8-de6cc8ae6460 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:55.743659 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-1d8d0302-fe41-4637-93eb-62628411077d req-440c72c6-8815-460c-b4f8-de6cc8ae6460 service nova] Creating event network-vif-deleted:2f9bf653-860b-4ebb-ba76-4f6b0284e567 for instance fa637fee-4d51-4d79-aed2-ed75805784bf on hv-cinder-84488 Jul 12 18:29:55.748803 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-1d8d0302-fe41-4637-93eb-62628411077d req-440c72c6-8815-460c-b4f8-de6cc8ae6460 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032228 Jul 12 18:29:55.749411 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 240/518] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:29:56.308105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d333207e-40a7-4b17-a00d-76091615eb4c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:56.308771 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d333207e-40a7-4b17-a00d-76091615eb4c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:56.314807 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d333207e-40a7-4b17-a00d-76091615eb4c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:56.315250 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d333207e-40a7-4b17-a00d-76091615eb4c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:56.316200 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d333207e-40a7-4b17-a00d-76091615eb4c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:56.316736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d333207e-40a7-4b17-a00d-76091615eb4c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:56.477342 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d333207e-40a7-4b17-a00d-76091615eb4c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:56.485820 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d333207e-40a7-4b17-a00d-76091615eb4c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.181730 Jul 12 18:29:56.491216 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 279/519] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:56 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:56.531632 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:56.532999 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:56.541391 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:56.541844 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:56.542624 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:56.543056 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:56.576773 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:56.577211 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:56.577835 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lazy-loading 'fault' on Instance uuid fa637fee-4d51-4d79-aed2-ed75805784bf {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:29:56.626352 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:56.637193 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:56.638952 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:56.640166 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3c904ffc-f521-4658-9b39-2eb08edc57c8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 200 len: 1371 microversion: 2.20 time: 0.113747 Jul 12 18:29:56.640766 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 241/520] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:56 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 1371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:29:57.507071 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7448bd5f-f197-42b6-98f3-5633fff82b70 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:57.507796 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7448bd5f-f197-42b6-98f3-5633fff82b70 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:57.514173 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7448bd5f-f197-42b6-98f3-5633fff82b70 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:57.514618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7448bd5f-f197-42b6-98f3-5633fff82b70 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:57.515390 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7448bd5f-f197-42b6-98f3-5633fff82b70 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:57.515823 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7448bd5f-f197-42b6-98f3-5633fff82b70 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:57.659004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-af366651-e466-41db-a3e4-247cec7afab2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:57.659616 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-af366651-e466-41db-a3e4-247cec7afab2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:57.667122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af366651-e466-41db-a3e4-247cec7afab2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:57.667565 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af366651-e466-41db-a3e4-247cec7afab2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:57.668361 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af366651-e466-41db-a3e4-247cec7afab2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:57.668797 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af366651-e466-41db-a3e4-247cec7afab2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:57.677654 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7448bd5f-f197-42b6-98f3-5633fff82b70 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:57.683885 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-af366651-e466-41db-a3e4-247cec7afab2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] HTTP exception thrown: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:29:57.686501 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7448bd5f-f197-42b6-98f3-5633fff82b70 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.182996 Jul 12 18:29:57.687445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 280/521] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:57 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-af366651-e466-41db-a3e4-247cec7afab2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Request method failure captured: Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf HTTP/1.1 Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbySjaUoQoYwJrd50L_CYSWxAfEM9A7_CFwU-hJTuVOrvE-mC5tpxmNayRhCK6hK5oGwnAwvx14AxsrbhJp-zax7RroLEzbZLPLTmQlzkX2Iz44iN5jb8MU316ZpmfXtmbF2mta299ZqaGO6IfOFB6XBMF6JfXwgAE0uiZLE4es8rCE Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:29:57.688441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_775c525b714e4f13ac5f34314243fe93", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: d5148114d71b401ca20f988485fb6c88 Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:29:57.690128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'fa637fee-4d51-4d79-aed2-ed75805784bf'} Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:29:57.691099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:29:57.692945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:29:57.694433 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-af366651-e466-41db-a3e4-247cec7afab2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Returning 404 to user: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:29:57.694433 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-af366651-e466-41db-a3e4-247cec7afab2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 404 len: 111 microversion: 2.20 time: 0.035231 Jul 12 18:29:57.694433 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 242/522] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:29:57 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:29:57.699060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-02cdec86-dece-4491-aa69-faea319e030c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '.version_select at 0x7f1bb0b7f4c0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:57.774937 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-02cdec86-dece-4491-aa69-faea319e030c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-118275102" status: 204 len: 0 microversion: 2.20 time: 0.079753 Jul 12 18:29:57.777153 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 281/523] 10.222.0.47 () {60 vars in 1258 bytes} [Tue Jul 12 18:29:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-118275102 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 18:29:58.625745 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e1bb3c72-0f1c-4fb0-b9b8-0102be972b85 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Action: 'create', calling method: .version_select at 0x7f1bb1439430>, body: {"keypair": {"name": "tempest-keypair-835920882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNFnBTaHsrjEK43w1d1Kg/0/bc/TvR98BjGojb/nfojNpX6fGPzw7+434QAHIHa2jU31xZJQVJznUAyXW6f8zI1lTqQSRV1G2CQyc9gd9d73og8plejy96wIuM5dYC+Cg=="}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:29:58.644324 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-e1bb3c72-0f1c-4fb0-b9b8-0102be972b85 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Getting quotas for project 775c525b714e4f13ac5f34314243fe93. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:29:58.648210 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-e1bb3c72-0f1c-4fb0-b9b8-0102be972b85 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Getting quotas for user d5148114d71b401ca20f988485fb6c88 and project 775c525b714e4f13ac5f34314243fe93. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:29:58.711226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9f244cc5-bae7-4f7a-b8e6-33f8608482ce tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:58.711885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9f244cc5-bae7-4f7a-b8e6-33f8608482ce tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:58.717988 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9f244cc5-bae7-4f7a-b8e6-33f8608482ce tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:58.718510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9f244cc5-bae7-4f7a-b8e6-33f8608482ce tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:58.719273 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9f244cc5-bae7-4f7a-b8e6-33f8608482ce tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:58.719712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9f244cc5-bae7-4f7a-b8e6-33f8608482ce tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:58.758443 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e1bb3c72-0f1c-4fb0-b9b8-0102be972b85 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.136551 Jul 12 18:29:58.759052 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 243/524] 10.222.0.47 () {62 vars in 1199 bytes} [Tue Jul 12 18:29:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 18:29:58.869552 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9f244cc5-bae7-4f7a-b8e6-33f8608482ce tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:29:58.878126 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9f244cc5-bae7-4f7a-b8e6-33f8608482ce tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.171119 Jul 12 18:29:58.878858 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 282/525] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:58 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:29:59.897930 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1853f08c-9ca0-4b85-b3ba-725e8674c176 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:29:59.900159 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1853f08c-9ca0-4b85-b3ba-725e8674c176 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:29:59.900541 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:59.905931 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1853f08c-9ca0-4b85-b3ba-725e8674c176 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:59.906370 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1853f08c-9ca0-4b85-b3ba-725e8674c176 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:29:59.907132 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1853f08c-9ca0-4b85-b3ba-725e8674c176 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:29:59.907558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1853f08c-9ca0-4b85-b3ba-725e8674c176 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:00.156666 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1853f08c-9ca0-4b85-b3ba-725e8674c176 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:00.164747 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1853f08c-9ca0-4b85-b3ba-725e8674c176 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.271939 Jul 12 18:30:00.165373 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 244/526] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:29:59 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:01.014879 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6cb45f93-3490-4f16-9739-061abdc04751 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:01.015852 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6cb45f93-3490-4f16-9739-061abdc04751 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:01.023413 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6cb45f93-3490-4f16-9739-061abdc04751 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:01.023857 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6cb45f93-3490-4f16-9739-061abdc04751 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:01.024665 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6cb45f93-3490-4f16-9739-061abdc04751 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:01.025097 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6cb45f93-3490-4f16-9739-061abdc04751 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:01.056072 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6cb45f93-3490-4f16-9739-061abdc04751 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045127 Jul 12 18:30:01.056677 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 283/527] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:30:01 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:30:01.120104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-aabea425-f7e8-43d6-a550-146253754977 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:01.120652 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-aabea425-f7e8-43d6-a550-146253754977 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:01.126745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-598301719", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31be3c15-cac8-48f6-8041-27a3024cda4f"}], "security_groups": [{"name": "tempest-securitygroup--16508713"}], "key_name": "tempest-keypair-835920882", "user_data": "}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:01.127506 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aabea425-f7e8-43d6-a550-146253754977 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:01.127951 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aabea425-f7e8-43d6-a550-146253754977 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:01.128750 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aabea425-f7e8-43d6-a550-146253754977 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:01.129178 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aabea425-f7e8-43d6-a550-146253754977 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:01.155953 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-aabea425-f7e8-43d6-a550-146253754977 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:30:01.232287 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] validate_networks() for [('31be3c15-cac8-48f6-8041-27a3024cda4f', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:30:01.443346 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-aabea425-f7e8-43d6-a550-146253754977 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 204 len: 0 microversion: 2.1 time: 0.326775 Jul 12 18:30:01.447302 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 245/528] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:30:01 2022] DELETE /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:30:01.453797 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-15166b5d-73b8-4bc7-9b8d-a39197ade74a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:01.454495 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-15166b5d-73b8-4bc7-9b8d-a39197ade74a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:01.462223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-15166b5d-73b8-4bc7-9b8d-a39197ade74a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:01.462923 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-15166b5d-73b8-4bc7-9b8d-a39197ade74a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:01.463822 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-15166b5d-73b8-4bc7-9b8d-a39197ade74a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:01.464295 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-15166b5d-73b8-4bc7-9b8d-a39197ade74a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:01.617160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-15166b5d-73b8-4bc7-9b8d-a39197ade74a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:01.620887 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:30:01.621307 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:30:01.621780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:30:01.622486 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:30:01.622862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:30:01.625898 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-15166b5d-73b8-4bc7-9b8d-a39197ade74a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.180417 Jul 12 18:30:01.628538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 246/529] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:01 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:01.631851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2c84915b-b399-46f9-bcdd-bf447e0d169c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:01.632480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2c84915b-b399-46f9-bcdd-bf447e0d169c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:01.633002 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:01.633539 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:01.634488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:01.635035 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:01.638464 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2c84915b-b399-46f9-bcdd-bf447e0d169c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:01.638904 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2c84915b-b399-46f9-bcdd-bf447e0d169c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:01.639658 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2c84915b-b399-46f9-bcdd-bf447e0d169c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:01.640343 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2c84915b-b399-46f9-bcdd-bf447e0d169c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:01.653231 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Getting quotas for project 775c525b714e4f13ac5f34314243fe93. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:30:01.657638 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Getting quotas for user d5148114d71b401ca20f988485fb6c88 and project 775c525b714e4f13ac5f34314243fe93. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:30:01.669078 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:30:01.671341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:30:01.772038 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2c84915b-b399-46f9-bcdd-bf447e0d169c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:01.779756 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2c84915b-b399-46f9-bcdd-bf447e0d169c tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1672 microversion: 2.1 time: 0.152267 Jul 12 18:30:01.780362 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 247/530] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:01 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:01.792757 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9555faeb-0c6c-42db-8f7c-a1b86cd44df4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.670379 Jul 12 18:30:01.794464 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 284/531] 10.222.0.47 () {62 vars in 1187 bytes} [Tue Jul 12 18:30:01 2022] POST /compute/v2.1/servers => generated 400 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 12 18:30:01.805488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-96903cdc-992d-4c39-8d98-ee4bd53b68d4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:01.806109 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-96903cdc-992d-4c39-8d98-ee4bd53b68d4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:01.864897 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-96903cdc-992d-4c39-8d98-ee4bd53b68d4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:01.872409 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-96903cdc-992d-4c39-8d98-ee4bd53b68d4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:01.873954 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-96903cdc-992d-4c39-8d98-ee4bd53b68d4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:01.875188 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-96903cdc-992d-4c39-8d98-ee4bd53b68d4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1280 microversion: 2.20 time: 0.074474 Jul 12 18:30:01.875742 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 248/532] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:30:01 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:30:02.643622 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2e7fdc9a-32dc-4bba-b5c3-2d62538a50eb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:02.644245 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2e7fdc9a-32dc-4bba-b5c3-2d62538a50eb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:02.650615 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2e7fdc9a-32dc-4bba-b5c3-2d62538a50eb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:02.651063 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2e7fdc9a-32dc-4bba-b5c3-2d62538a50eb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:02.651826 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2e7fdc9a-32dc-4bba-b5c3-2d62538a50eb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:02.652264 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2e7fdc9a-32dc-4bba-b5c3-2d62538a50eb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:02.797813 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-843052fa-74f9-47df-b239-64b409cf5819 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:02.798565 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-843052fa-74f9-47df-b239-64b409cf5819 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:02.799303 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2e7fdc9a-32dc-4bba-b5c3-2d62538a50eb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:02.806633 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-843052fa-74f9-47df-b239-64b409cf5819 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:02.807080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-843052fa-74f9-47df-b239-64b409cf5819 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:02.807851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-843052fa-74f9-47df-b239-64b409cf5819 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:02.808172 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2e7fdc9a-32dc-4bba-b5c3-2d62538a50eb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1758 microversion: 2.1 time: 0.168339 Jul 12 18:30:02.808322 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-843052fa-74f9-47df-b239-64b409cf5819 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:02.808714 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 285/533] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:02 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:02.896451 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f6229c12-0d68-4879-80bf-ae13a9a5680b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:02.896939 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f6229c12-0d68-4879-80bf-ae13a9a5680b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:02.903300 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f6229c12-0d68-4879-80bf-ae13a9a5680b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:02.903782 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f6229c12-0d68-4879-80bf-ae13a9a5680b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:02.904577 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f6229c12-0d68-4879-80bf-ae13a9a5680b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:02.905019 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f6229c12-0d68-4879-80bf-ae13a9a5680b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:02.941613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-843052fa-74f9-47df-b239-64b409cf5819 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:02.949427 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-843052fa-74f9-47df-b239-64b409cf5819 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1672 microversion: 2.1 time: 0.155488 Jul 12 18:30:02.955944 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 249/534] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:02 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:02.976287 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f6229c12-0d68-4879-80bf-ae13a9a5680b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:02.984423 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f6229c12-0d68-4879-80bf-ae13a9a5680b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:02.985978 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f6229c12-0d68-4879-80bf-ae13a9a5680b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:02.987355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f6229c12-0d68-4879-80bf-ae13a9a5680b tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1284 microversion: 2.20 time: 0.094968 Jul 12 18:30:02.987896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 286/535] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:30:02 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:30:03.824871 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ce2ff1ce-7b8e-4e62-aa26-5a2701788615 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:03.825476 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ce2ff1ce-7b8e-4e62-aa26-5a2701788615 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:03.833551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce2ff1ce-7b8e-4e62-aa26-5a2701788615 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:03.834059 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce2ff1ce-7b8e-4e62-aa26-5a2701788615 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:03.834882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce2ff1ce-7b8e-4e62-aa26-5a2701788615 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:03.835324 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce2ff1ce-7b8e-4e62-aa26-5a2701788615 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:03.968416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-02fd3afa-ccb3-4cdd-8fb4-02d3317ce3c7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:03.969038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-02fd3afa-ccb3-4cdd-8fb4-02d3317ce3c7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:03.976496 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02fd3afa-ccb3-4cdd-8fb4-02d3317ce3c7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:03.980912 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02fd3afa-ccb3-4cdd-8fb4-02d3317ce3c7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:03.980912 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02fd3afa-ccb3-4cdd-8fb4-02d3317ce3c7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:03.980912 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02fd3afa-ccb3-4cdd-8fb4-02d3317ce3c7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:04.145685 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-02fd3afa-ccb3-4cdd-8fb4-02d3317ce3c7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:04.148223 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:04.154473 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-02fd3afa-ccb3-4cdd-8fb4-02d3317ce3c7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1672 microversion: 2.1 time: 0.189957 Jul 12 18:30:04.160810 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 287/536] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:03 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1672 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:04.161607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0f816efb-4162-4f3a-ac8c-5cad74d06185 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:04.162082 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0f816efb-4162-4f3a-ac8c-5cad74d06185 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:04.169545 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0f816efb-4162-4f3a-ac8c-5cad74d06185 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:04.170007 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0f816efb-4162-4f3a-ac8c-5cad74d06185 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:04.170785 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0f816efb-4162-4f3a-ac8c-5cad74d06185 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:04.171248 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0f816efb-4162-4f3a-ac8c-5cad74d06185 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:04.239974 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0f816efb-4162-4f3a-ac8c-5cad74d06185 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:04.249411 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0f816efb-4162-4f3a-ac8c-5cad74d06185 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:04.251043 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0f816efb-4162-4f3a-ac8c-5cad74d06185 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:04.252189 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0f816efb-4162-4f3a-ac8c-5cad74d06185 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1332 microversion: 2.20 time: 0.096188 Jul 12 18:30:04.253080 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 288/537] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:30:04 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:30:04.339074 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ce2ff1ce-7b8e-4e62-aa26-5a2701788615 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:04.347804 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ce2ff1ce-7b8e-4e62-aa26-5a2701788615 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1761 microversion: 2.1 time: 0.526940 Jul 12 18:30:04.348556 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 250/538] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:03 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1761 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:04.853993 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-42759854-54c7-45c8-a57f-9481c7376496 req-1dea8974-5f83-4597-a417-eb17a4ef9685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f6ad973-f294-4c83-bb32-5d90270ada90", "name": "network-vif-deleted", "tag": "4cea184a-9c42-4328-b0c5-312d0aa3b4e3"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:04.862738 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-42759854-54c7-45c8-a57f-9481c7376496 req-1dea8974-5f83-4597-a417-eb17a4ef9685 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:04.863177 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-42759854-54c7-45c8-a57f-9481c7376496 req-1dea8974-5f83-4597-a417-eb17a4ef9685 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:04.876318 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-42759854-54c7-45c8-a57f-9481c7376496 req-1dea8974-5f83-4597-a417-eb17a4ef9685 service nova] Creating event network-vif-deleted:4cea184a-9c42-4328-b0c5-312d0aa3b4e3 for instance 5f6ad973-f294-4c83-bb32-5d90270ada90 on hv-cinder-84488 Jul 12 18:30:04.882361 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-42759854-54c7-45c8-a57f-9481c7376496 req-1dea8974-5f83-4597-a417-eb17a4ef9685 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032131 Jul 12 18:30:04.883370 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 289/539] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:05.174970 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f9265544-3600-4c54-a2f6-bf5385f68813 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:05.175749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f9265544-3600-4c54-a2f6-bf5385f68813 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:05.194144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9265544-3600-4c54-a2f6-bf5385f68813 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:05.196609 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9265544-3600-4c54-a2f6-bf5385f68813 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:05.196609 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9265544-3600-4c54-a2f6-bf5385f68813 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:05.196609 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9265544-3600-4c54-a2f6-bf5385f68813 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:05.250782 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9265544-3600-4c54-a2f6-bf5385f68813 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:05.251225 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9265544-3600-4c54-a2f6-bf5385f68813 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:05.251669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-f9265544-3600-4c54-a2f6-bf5385f68813 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lazy-loading 'fault' on Instance uuid 5f6ad973-f294-4c83-bb32-5d90270ada90 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:30:05.272701 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2273ed6c-7194-4c5a-93ac-5469094fd7fc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:05.276843 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2273ed6c-7194-4c5a-93ac-5469094fd7fc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:05.280282 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2273ed6c-7194-4c5a-93ac-5469094fd7fc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:05.280873 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2273ed6c-7194-4c5a-93ac-5469094fd7fc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:05.281808 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2273ed6c-7194-4c5a-93ac-5469094fd7fc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:05.282489 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2273ed6c-7194-4c5a-93ac-5469094fd7fc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:05.299360 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f9265544-3600-4c54-a2f6-bf5385f68813 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:05.308842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f9265544-3600-4c54-a2f6-bf5385f68813 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 200 len: 1328 microversion: 2.1 time: 0.139206 Jul 12 18:30:05.309419 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 251/540] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:05 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 1328 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:05.354808 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2273ed6c-7194-4c5a-93ac-5469094fd7fc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:05.367778 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2273ed6c-7194-4c5a-93ac-5469094fd7fc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:05.369720 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2273ed6c-7194-4c5a-93ac-5469094fd7fc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:05.371068 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2273ed6c-7194-4c5a-93ac-5469094fd7fc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1350 microversion: 2.20 time: 0.103759 Jul 12 18:30:05.371623 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 290/541] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:30:05 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:30:06.326500 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6ec3d46f-a9fd-4025-a85a-1882b7b77256 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:06.327135 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6ec3d46f-a9fd-4025-a85a-1882b7b77256 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:06.334280 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ec3d46f-a9fd-4025-a85a-1882b7b77256 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:06.334715 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ec3d46f-a9fd-4025-a85a-1882b7b77256 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:06.335489 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ec3d46f-a9fd-4025-a85a-1882b7b77256 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:06.335911 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ec3d46f-a9fd-4025-a85a-1882b7b77256 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:06.340783 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:06.350452 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-6ec3d46f-a9fd-4025-a85a-1882b7b77256 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] HTTP exception thrown: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6ec3d46f-a9fd-4025-a85a-1882b7b77256 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Request method failure captured: Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 HTTP/1.1 Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyTK2cglfIhsWmClIjvvw0ixT4AZL6zvouNndOncdOPbbmyePUraqqwQ7i69WBCMNeKNwLsq8xkYS0i_RTVxs3mA3f9WqA369AlOyqWWVQYjLuQUuMKYeTGgfL0Sw7KjtMqYc46damKQeCQLDeIfU7KYgUqowR1i2axRS9raAQo1ZQ Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:30:06.352079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d00edd8bebc34098919b25aafca8974b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 29bc0d7e30794a6abb292dc65329ed9e Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:30:06.353682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '5f6ad973-f294-4c83-bb32-5d90270ada90'} Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:30:06.356875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:30:06.358341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:06.360148 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6ec3d46f-a9fd-4025-a85a-1882b7b77256 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Returning 404 to user: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:30:06.360148 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6ec3d46f-a9fd-4025-a85a-1882b7b77256 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 404 len: 111 microversion: 2.1 time: 0.031049 Jul 12 18:30:06.360148 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 252/542] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:06 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:30:06.365295 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3d2dc562-b776-42c8-b0ac-c8773e2127fc tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '.version_select at 0x7f1bb0be5310>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:06.390988 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fc29b65d-663f-4ca2-b774-a002f5e9715a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:06.393650 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fc29b65d-663f-4ca2-b774-a002f5e9715a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:06.399348 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fc29b65d-663f-4ca2-b774-a002f5e9715a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:06.399784 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fc29b65d-663f-4ca2-b774-a002f5e9715a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:06.400644 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fc29b65d-663f-4ca2-b774-a002f5e9715a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:06.401067 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fc29b65d-663f-4ca2-b774-a002f5e9715a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:06.437806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3d2dc562-b776-42c8-b0ac-c8773e2127fc tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363270877" status: 202 len: 0 microversion: 2.1 time: 0.078419 Jul 12 18:30:06.438395 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 291/543] 10.222.0.47 () {58 vars in 1220 bytes} [Tue Jul 12 18:30:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363270877 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:30:06.699000 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fc29b65d-663f-4ca2-b774-a002f5e9715a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:06.708844 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fc29b65d-663f-4ca2-b774-a002f5e9715a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:06.710389 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fc29b65d-663f-4ca2-b774-a002f5e9715a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:06.711841 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fc29b65d-663f-4ca2-b774-a002f5e9715a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1404 microversion: 2.20 time: 0.324732 Jul 12 18:30:06.712565 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 253/544] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:30:06 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1404 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:30:07.053414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-ee991496-f513-46d5-a26f-5f5b2b2c6eaa req-8d37d556-8a5f-4ea8-b70f-0952df1e512b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a", "tag": "f5d11a8c-c702-4fa1-8cbd-ab67a930e714"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:07.062586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-ee991496-f513-46d5-a26f-5f5b2b2c6eaa req-8d37d556-8a5f-4ea8-b70f-0952df1e512b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:07.063954 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-ee991496-f513-46d5-a26f-5f5b2b2c6eaa req-8d37d556-8a5f-4ea8-b70f-0952df1e512b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:07.077222 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-ee991496-f513-46d5-a26f-5f5b2b2c6eaa req-8d37d556-8a5f-4ea8-b70f-0952df1e512b service nova] Creating event network-changed:f5d11a8c-c702-4fa1-8cbd-ab67a930e714 for instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a on hv-cinder-84488 Jul 12 18:30:07.082577 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-ee991496-f513-46d5-a26f-5f5b2b2c6eaa req-8d37d556-8a5f-4ea8-b70f-0952df1e512b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034336 Jul 12 18:30:07.087983 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 292/545] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:07.730433 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-59f7fc7b-9e5c-49ee-b748-62e5cf2f0bff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:07.731246 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-59f7fc7b-9e5c-49ee-b748-62e5cf2f0bff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:07.738920 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59f7fc7b-9e5c-49ee-b748-62e5cf2f0bff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:07.739358 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59f7fc7b-9e5c-49ee-b748-62e5cf2f0bff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:07.740215 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59f7fc7b-9e5c-49ee-b748-62e5cf2f0bff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:07.740682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59f7fc7b-9e5c-49ee-b748-62e5cf2f0bff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:07.896200 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c687b684-2a2f-4af2-bf76-9f2be708624f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Action: 'create', calling method: .version_select at 0x7f1bb0ac23a0>, body: {"keypair": {"name": "tempest-keypair-1745610182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7QwEsHyxOe4mzpsxvnmObB2yfykzC3KKjFMSAZpa0fhyGW52GcKTv/qn4DfXgAAuYTa1YUqpsHUHcm+Y52IgfU5S8kJFparkn+Ikh++le7tY4SmkDVCwcFW6OyYj/1Ng=="}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:07.911278 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-c687b684-2a2f-4af2-bf76-9f2be708624f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Getting quotas for project d00edd8bebc34098919b25aafca8974b. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:30:07.915781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-c687b684-2a2f-4af2-bf76-9f2be708624f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Getting quotas for user 29bc0d7e30794a6abb292dc65329ed9e and project d00edd8bebc34098919b25aafca8974b. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:30:07.987334 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c687b684-2a2f-4af2-bf76-9f2be708624f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096153 Jul 12 18:30:07.988227 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 293/546] 10.222.0.47 () {60 vars in 1158 bytes} [Tue Jul 12 18:30:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:07.988388 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-59f7fc7b-9e5c-49ee-b748-62e5cf2f0bff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:07.998327 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-59f7fc7b-9e5c-49ee-b748-62e5cf2f0bff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:08.000149 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-59f7fc7b-9e5c-49ee-b748-62e5cf2f0bff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:08.001732 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-59f7fc7b-9e5c-49ee-b748-62e5cf2f0bff tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1404 microversion: 2.20 time: 0.275191 Jul 12 18:30:08.002426 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 254/547] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:30:07 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1404 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:30:09.019268 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-43755910-371f-43f5-826c-317e21715df6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:09.019972 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-43755910-371f-43f5-826c-317e21715df6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:09.026483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43755910-371f-43f5-826c-317e21715df6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:09.026926 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43755910-371f-43f5-826c-317e21715df6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:09.027684 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43755910-371f-43f5-826c-317e21715df6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:09.028120 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43755910-371f-43f5-826c-317e21715df6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:09.425278 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-43755910-371f-43f5-826c-317e21715df6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:09.434020 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-43755910-371f-43f5-826c-317e21715df6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:09.435532 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-43755910-371f-43f5-826c-317e21715df6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:09.436760 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-43755910-371f-43f5-826c-317e21715df6 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1404 microversion: 2.20 time: 0.421551 Jul 12 18:30:09.442924 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 294/548] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:30:09 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:30:10.420735 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1510604835", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7032ac62-2013-478c-b8b7-c90e03eb0070"}], "security_groups": [{"name": "tempest-securitygroup--1161463311"}], "key_name": "tempest-keypair-1745610182", "user_data": "}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:10.459093 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8a8f2545-b742-4e19-9b4a-468b4a95b741 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:10.459874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8a8f2545-b742-4e19-9b4a-468b4a95b741 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:10.469050 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8a8f2545-b742-4e19-9b4a-468b4a95b741 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:10.469499 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8a8f2545-b742-4e19-9b4a-468b4a95b741 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:10.470518 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8a8f2545-b742-4e19-9b4a-468b4a95b741 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:10.470957 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8a8f2545-b742-4e19-9b4a-468b4a95b741 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:10.645982 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8a8f2545-b742-4e19-9b4a-468b4a95b741 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:10.654720 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8a8f2545-b742-4e19-9b4a-468b4a95b741 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:10.656357 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8a8f2545-b742-4e19-9b4a-468b4a95b741 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:10.657564 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8a8f2545-b742-4e19-9b4a-468b4a95b741 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1404 microversion: 2.20 time: 0.206262 Jul 12 18:30:10.658255 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 295/549] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:30:10 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1404 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:30:10.664079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9d21e247-5d2c-409c-b652-f595bde9b774 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:10.664586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9d21e247-5d2c-409c-b652-f595bde9b774 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:10.670658 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d21e247-5d2c-409c-b652-f595bde9b774 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:10.671108 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d21e247-5d2c-409c-b652-f595bde9b774 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:10.671870 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d21e247-5d2c-409c-b652-f595bde9b774 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:10.672293 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d21e247-5d2c-409c-b652-f595bde9b774 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:10.719618 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] validate_networks() for [('7032ac62-2013-478c-b8b7-c90e03eb0070', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:30:10.764913 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-9d21e247-5d2c-409c-b652-f595bde9b774 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lazy-loading 'services' on Instance uuid f7062eaf-78a1-4879-9edb-6465141472bc {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:30:11.064298 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9d21e247-5d2c-409c-b652-f595bde9b774 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments/b167d5c7-cabd-4576-94f0-a6d4425fd038" status: 202 len: 0 microversion: 2.1 time: 0.404521 Jul 12 18:30:11.065030 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 296/550] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:30:10 2022] DELETE /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments/b167d5c7-cabd-4576-94f0-a6d4425fd038 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:30:11.074165 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d05c27ed-f30f-4d04-a176-76e8c823026d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:11.078159 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d05c27ed-f30f-4d04-a176-76e8c823026d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:11.084143 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d05c27ed-f30f-4d04-a176-76e8c823026d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:11.084625 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d05c27ed-f30f-4d04-a176-76e8c823026d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:11.085421 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d05c27ed-f30f-4d04-a176-76e8c823026d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:11.085862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d05c27ed-f30f-4d04-a176-76e8c823026d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:11.119673 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d05c27ed-f30f-4d04-a176-76e8c823026d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049710 Jul 12 18:30:11.120087 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 297/551] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:30:11 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:30:11.427333 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:30:11.427881 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:30:11.428198 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:30:11.428791 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:30:11.429214 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:30:11.439575 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:11.440020 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:11.440894 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:11.441336 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:11.461646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Getting quotas for project d00edd8bebc34098919b25aafca8974b. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:30:11.466204 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Getting quotas for user 29bc0d7e30794a6abb292dc65329ed9e and project d00edd8bebc34098919b25aafca8974b. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:30:11.479251 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:30:11.489618 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:30:11.607899 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e26c950b-5b73-4f0b-a9d2-97f3fcee196b tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.192582 Jul 12 18:30:11.608809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 255/552] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:30:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:30:11.619085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-65c84985-7319-4020-88a8-19fe6cac167f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:11.619858 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-65c84985-7319-4020-88a8-19fe6cac167f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:11.645735 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:11.685471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9a0c3494-f686-4479-9b1c-b70960bb3d43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:11.685993 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-65c84985-7319-4020-88a8-19fe6cac167f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:11.686160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9a0c3494-f686-4479-9b1c-b70960bb3d43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:11.705260 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-65c84985-7319-4020-88a8-19fe6cac167f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1238 microversion: 2.1 time: 0.078803 Jul 12 18:30:11.705260 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 298/553] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:11 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:11.705939 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a0c3494-f686-4479-9b1c-b70960bb3d43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:11.705939 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a0c3494-f686-4479-9b1c-b70960bb3d43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:11.705939 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a0c3494-f686-4479-9b1c-b70960bb3d43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:11.705939 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a0c3494-f686-4479-9b1c-b70960bb3d43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:11.852766 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9a0c3494-f686-4479-9b1c-b70960bb3d43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:11.862410 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9a0c3494-f686-4479-9b1c-b70960bb3d43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:11.865996 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9a0c3494-f686-4479-9b1c-b70960bb3d43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:11.866171 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9a0c3494-f686-4479-9b1c-b70960bb3d43 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1404 microversion: 2.20 time: 0.185450 Jul 12 18:30:11.867034 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 256/554] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:30:11 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:30:12.050378 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-47f50ad0-c6b3-4f27-9e20-725f8a6243b6 req-9a7aa072-051e-4d3d-88cc-67f44b6f5aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a", "name": "network-vif-plugged", "status": "completed", "tag": "f5d11a8c-c702-4fa1-8cbd-ab67a930e714"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:12.064003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-47f50ad0-c6b3-4f27-9e20-725f8a6243b6 req-9a7aa072-051e-4d3d-88cc-67f44b6f5aba service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:12.067410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-47f50ad0-c6b3-4f27-9e20-725f8a6243b6 req-9a7aa072-051e-4d3d-88cc-67f44b6f5aba service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:12.086792 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-47f50ad0-c6b3-4f27-9e20-725f8a6243b6 req-9a7aa072-051e-4d3d-88cc-67f44b6f5aba service nova] Creating event network-vif-plugged:f5d11a8c-c702-4fa1-8cbd-ab67a930e714 for instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a on hv-cinder-84488 Jul 12 18:30:12.095028 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-47f50ad0-c6b3-4f27-9e20-725f8a6243b6 req-9a7aa072-051e-4d3d-88cc-67f44b6f5aba service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049743 Jul 12 18:30:12.095652 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 299/555] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:12.131461 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9b0292cb-bd06-40c2-bb08-6665922f73b4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:12.132714 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9b0292cb-bd06-40c2-bb08-6665922f73b4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:12.139001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b0292cb-bd06-40c2-bb08-6665922f73b4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:12.139492 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b0292cb-bd06-40c2-bb08-6665922f73b4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:12.140703 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b0292cb-bd06-40c2-bb08-6665922f73b4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:12.141209 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b0292cb-bd06-40c2-bb08-6665922f73b4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:12.197124 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9b0292cb-bd06-40c2-bb08-6665922f73b4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069758 Jul 12 18:30:12.198844 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 257/556] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:30:12 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:12.712041 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b03e2ec2-50ed-4629-9e15-ec3812e6bad7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:12.712768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b03e2ec2-50ed-4629-9e15-ec3812e6bad7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:12.719180 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b03e2ec2-50ed-4629-9e15-ec3812e6bad7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:12.719655 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b03e2ec2-50ed-4629-9e15-ec3812e6bad7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:12.720451 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b03e2ec2-50ed-4629-9e15-ec3812e6bad7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:12.720884 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b03e2ec2-50ed-4629-9e15-ec3812e6bad7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:12.787487 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b03e2ec2-50ed-4629-9e15-ec3812e6bad7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:12.795104 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b03e2ec2-50ed-4629-9e15-ec3812e6bad7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1242 microversion: 2.1 time: 0.087751 Jul 12 18:30:12.795672 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 300/557] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:12 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:12.887118 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-56aa7305-002b-4c24-964b-88fa2781f417 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:12.887718 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-56aa7305-002b-4c24-964b-88fa2781f417 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:12.894388 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-56aa7305-002b-4c24-964b-88fa2781f417 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:12.894827 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-56aa7305-002b-4c24-964b-88fa2781f417 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:12.895585 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-56aa7305-002b-4c24-964b-88fa2781f417 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:12.896011 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-56aa7305-002b-4c24-964b-88fa2781f417 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:13.107615 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-56aa7305-002b-4c24-964b-88fa2781f417 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:13.117144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-56aa7305-002b-4c24-964b-88fa2781f417 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:13.118656 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-56aa7305-002b-4c24-964b-88fa2781f417 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:13.119763 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-56aa7305-002b-4c24-964b-88fa2781f417 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1404 microversion: 2.20 time: 0.236784 Jul 12 18:30:13.120401 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 258/558] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:30:12 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1404 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:30:13.208963 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-87c912f0-652a-42bb-a4d6-eec7d003815e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:13.209889 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-87c912f0-652a-42bb-a4d6-eec7d003815e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:13.215940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-87c912f0-652a-42bb-a4d6-eec7d003815e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:13.216437 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-87c912f0-652a-42bb-a4d6-eec7d003815e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:13.217256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-87c912f0-652a-42bb-a4d6-eec7d003815e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:13.217692 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-87c912f0-652a-42bb-a4d6-eec7d003815e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:13.248386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-87c912f0-652a-42bb-a4d6-eec7d003815e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043344 Jul 12 18:30:13.248946 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 301/559] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:30:13 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:30:13.326098 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5e0f245b-d5d8-4caa-8622-cf65cd314138 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:13.326583 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5e0f245b-d5d8-4caa-8622-cf65cd314138 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:13.333999 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e0f245b-d5d8-4caa-8622-cf65cd314138 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:13.334449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e0f245b-d5d8-4caa-8622-cf65cd314138 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:13.335258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e0f245b-d5d8-4caa-8622-cf65cd314138 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:13.335699 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e0f245b-d5d8-4caa-8622-cf65cd314138 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:13.365387 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5e0f245b-d5d8-4caa-8622-cf65cd314138 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:30:13.665169 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5e0f245b-d5d8-4caa-8622-cf65cd314138 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 204 len: 0 microversion: 2.1 time: 0.342105 Jul 12 18:30:13.666560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 259/560] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:30:13 2022] DELETE /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:30:13.680510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e094bd9c-692e-4eaf-bd88-7418b7d7c5d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:13.681597 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e094bd9c-692e-4eaf-bd88-7418b7d7c5d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:13.685186 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:13.694161 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e094bd9c-692e-4eaf-bd88-7418b7d7c5d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:13.694975 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e094bd9c-692e-4eaf-bd88-7418b7d7c5d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:13.696373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e094bd9c-692e-4eaf-bd88-7418b7d7c5d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:13.697265 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e094bd9c-692e-4eaf-bd88-7418b7d7c5d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:13.818824 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7c08ed45-0b0a-4cfb-a944-8ede133bab0a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:13.820105 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7c08ed45-0b0a-4cfb-a944-8ede133bab0a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:13.833908 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c08ed45-0b0a-4cfb-a944-8ede133bab0a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:13.834886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c08ed45-0b0a-4cfb-a944-8ede133bab0a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:13.836938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c08ed45-0b0a-4cfb-a944-8ede133bab0a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:13.837849 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c08ed45-0b0a-4cfb-a944-8ede133bab0a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:13.876633 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e094bd9c-692e-4eaf-bd88-7418b7d7c5d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:13.884725 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e094bd9c-692e-4eaf-bd88-7418b7d7c5d8 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1689 microversion: 2.1 time: 0.211733 Jul 12 18:30:13.885622 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 302/561] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:13 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1689 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:13.916234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7c08ed45-0b0a-4cfb-a944-8ede133bab0a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:13.924061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7c08ed45-0b0a-4cfb-a944-8ede133bab0a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1234 microversion: 2.1 time: 0.113252 Jul 12 18:30:13.925559 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 260/562] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:13 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1234 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:14.138785 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-62a11a33-5242-457f-8d56-339fbb599606 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:14.139354 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-62a11a33-5242-457f-8d56-339fbb599606 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:14.145711 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-62a11a33-5242-457f-8d56-339fbb599606 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:14.146156 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-62a11a33-5242-457f-8d56-339fbb599606 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:14.146942 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-62a11a33-5242-457f-8d56-339fbb599606 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:14.147473 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-62a11a33-5242-457f-8d56-339fbb599606 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:14.283453 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-62a11a33-5242-457f-8d56-339fbb599606 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:14.291788 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-62a11a33-5242-457f-8d56-339fbb599606 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:14.293316 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-62a11a33-5242-457f-8d56-339fbb599606 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:14.294470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-62a11a33-5242-457f-8d56-339fbb599606 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1597 microversion: 2.20 time: 0.159773 Jul 12 18:30:14.295025 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 303/563] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:30:14 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1597 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:30:14.313824 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a802acb8-82dd-4f62-86a5-e0a4874f261e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:14.314317 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a802acb8-82dd-4f62-86a5-e0a4874f261e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:14.321228 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a802acb8-82dd-4f62-86a5-e0a4874f261e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:14.321671 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a802acb8-82dd-4f62-86a5-e0a4874f261e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:14.322438 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a802acb8-82dd-4f62-86a5-e0a4874f261e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:14.322869 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a802acb8-82dd-4f62-86a5-e0a4874f261e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:14.407125 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a802acb8-82dd-4f62-86a5-e0a4874f261e tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097170 Jul 12 18:30:14.407716 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 261/564] 10.222.0.47 () {60 vars in 1315 bytes} [Tue Jul 12 18:30:14 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:30:14.903435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5c648d23-74fc-4cf8-b8e4-4e8c8ed99c53 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:14.904808 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5c648d23-74fc-4cf8-b8e4-4e8c8ed99c53 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:14.913232 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5c648d23-74fc-4cf8-b8e4-4e8c8ed99c53 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:14.914012 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5c648d23-74fc-4cf8-b8e4-4e8c8ed99c53 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:14.915646 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5c648d23-74fc-4cf8-b8e4-4e8c8ed99c53 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:14.916506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5c648d23-74fc-4cf8-b8e4-4e8c8ed99c53 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:14.943429 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7f8f90a8-2ec8-4680-9b7e-6d3457539685 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:14.945019 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7f8f90a8-2ec8-4680-9b7e-6d3457539685 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:14.951364 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7f8f90a8-2ec8-4680-9b7e-6d3457539685 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:14.951858 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7f8f90a8-2ec8-4680-9b7e-6d3457539685 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:14.952660 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7f8f90a8-2ec8-4680-9b7e-6d3457539685 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:14.953092 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7f8f90a8-2ec8-4680-9b7e-6d3457539685 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:15.021986 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7f8f90a8-2ec8-4680-9b7e-6d3457539685 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:15.029900 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7f8f90a8-2ec8-4680-9b7e-6d3457539685 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1234 microversion: 2.1 time: 0.091722 Jul 12 18:30:15.030488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 262/565] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:14 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1234 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:15.065697 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5c648d23-74fc-4cf8-b8e4-4e8c8ed99c53 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:15.074070 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5c648d23-74fc-4cf8-b8e4-4e8c8ed99c53 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1689 microversion: 2.1 time: 0.175344 Jul 12 18:30:15.074642 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 304/566] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:14 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:15.527388 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-9e2c6db9-d394-4cdc-8ff1-e82e5066f22e req-1250e7bf-c5c5-41db-8242-d55904b2a4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a", "tag": "f5d11a8c-c702-4fa1-8cbd-ab67a930e714"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:15.536297 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-9e2c6db9-d394-4cdc-8ff1-e82e5066f22e req-1250e7bf-c5c5-41db-8242-d55904b2a4e9 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:15.536827 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-9e2c6db9-d394-4cdc-8ff1-e82e5066f22e req-1250e7bf-c5c5-41db-8242-d55904b2a4e9 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:15.548451 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-9e2c6db9-d394-4cdc-8ff1-e82e5066f22e req-1250e7bf-c5c5-41db-8242-d55904b2a4e9 service nova] Creating event network-changed:f5d11a8c-c702-4fa1-8cbd-ab67a930e714 for instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a on hv-cinder-84488 Jul 12 18:30:15.554416 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-9e2c6db9-d394-4cdc-8ff1-e82e5066f22e req-1250e7bf-c5c5-41db-8242-d55904b2a4e9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030570 Jul 12 18:30:15.555019 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 263/567] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:16.050684 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2057ae32-f5ef-4c47-92f5-4f3978e6405e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:16.052468 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2057ae32-f5ef-4c47-92f5-4f3978e6405e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:16.061542 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2057ae32-f5ef-4c47-92f5-4f3978e6405e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:16.062466 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2057ae32-f5ef-4c47-92f5-4f3978e6405e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:16.063740 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2057ae32-f5ef-4c47-92f5-4f3978e6405e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:16.064714 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2057ae32-f5ef-4c47-92f5-4f3978e6405e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:16.151921 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2057ae32-f5ef-4c47-92f5-4f3978e6405e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:16.167519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2057ae32-f5ef-4c47-92f5-4f3978e6405e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1234 microversion: 2.1 time: 0.123515 Jul 12 18:30:16.168752 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 305/568] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:16 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1234 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:16.243999 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-28a4a76f-6f48-44f8-9297-9b2dc20ca798 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:16.244719 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-28a4a76f-6f48-44f8-9297-9b2dc20ca798 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:16.251184 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28a4a76f-6f48-44f8-9297-9b2dc20ca798 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:16.251620 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28a4a76f-6f48-44f8-9297-9b2dc20ca798 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:16.252480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28a4a76f-6f48-44f8-9297-9b2dc20ca798 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:16.252902 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28a4a76f-6f48-44f8-9297-9b2dc20ca798 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:16.409548 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-28a4a76f-6f48-44f8-9297-9b2dc20ca798 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:16.422258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-28a4a76f-6f48-44f8-9297-9b2dc20ca798 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1689 microversion: 2.1 time: 0.334736 Jul 12 18:30:16.423192 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 264/569] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:16 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1689 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:17.185652 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-02c2059f-cb5c-4085-a93c-0f31c11070b3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:17.186265 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-02c2059f-cb5c-4085-a93c-0f31c11070b3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:17.195269 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02c2059f-cb5c-4085-a93c-0f31c11070b3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:17.196083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02c2059f-cb5c-4085-a93c-0f31c11070b3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:17.197425 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02c2059f-cb5c-4085-a93c-0f31c11070b3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:17.198083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-02c2059f-cb5c-4085-a93c-0f31c11070b3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:17.265310 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-02c2059f-cb5c-4085-a93c-0f31c11070b3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:17.274407 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-02c2059f-cb5c-4085-a93c-0f31c11070b3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1234 microversion: 2.1 time: 0.092463 Jul 12 18:30:17.275190 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 306/570] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:17 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1234 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:17.442037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e85316c5-547a-46cd-9de6-4e6f0dd41a2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:17.442860 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e85316c5-547a-46cd-9de6-4e6f0dd41a2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:17.450829 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e85316c5-547a-46cd-9de6-4e6f0dd41a2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:17.451267 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e85316c5-547a-46cd-9de6-4e6f0dd41a2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:17.452605 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e85316c5-547a-46cd-9de6-4e6f0dd41a2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:17.453055 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e85316c5-547a-46cd-9de6-4e6f0dd41a2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:17.596898 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e85316c5-547a-46cd-9de6-4e6f0dd41a2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:17.605646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e85316c5-547a-46cd-9de6-4e6f0dd41a2c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1689 microversion: 2.1 time: 0.169234 Jul 12 18:30:17.606242 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 265/571] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:17 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:18.298551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5a9d6593-88db-4638-a962-1e6833c11da2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:18.299774 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5a9d6593-88db-4638-a962-1e6833c11da2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:18.306606 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5a9d6593-88db-4638-a962-1e6833c11da2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:18.307050 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5a9d6593-88db-4638-a962-1e6833c11da2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:18.308020 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5a9d6593-88db-4638-a962-1e6833c11da2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:18.308551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5a9d6593-88db-4638-a962-1e6833c11da2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:18.392467 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5a9d6593-88db-4638-a962-1e6833c11da2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:18.401275 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5a9d6593-88db-4638-a962-1e6833c11da2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1234 microversion: 2.1 time: 0.106502 Jul 12 18:30:18.401877 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 307/572] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:18 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1234 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:18.622913 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-75da60dd-e8bf-4a92-87b9-5d9aeaf7229d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:18.623442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-75da60dd-e8bf-4a92-87b9-5d9aeaf7229d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:18.630723 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75da60dd-e8bf-4a92-87b9-5d9aeaf7229d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:18.631163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75da60dd-e8bf-4a92-87b9-5d9aeaf7229d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:18.631930 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75da60dd-e8bf-4a92-87b9-5d9aeaf7229d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:18.632373 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75da60dd-e8bf-4a92-87b9-5d9aeaf7229d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:18.715788 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-75da60dd-e8bf-4a92-87b9-5d9aeaf7229d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:18.725128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-75da60dd-e8bf-4a92-87b9-5d9aeaf7229d tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1622 microversion: 2.1 time: 0.105951 Jul 12 18:30:18.725780 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 266/573] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:18 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1622 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:18.978821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-c4b8310d-5109-4f5d-b58b-52ed28e219be req-ab67fcd8-8bb5-4c6d-bf6d-da08c63d4bd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7062eaf-78a1-4879-9edb-6465141472bc", "name": "network-vif-deleted", "tag": "481a00ce-3877-4a82-887d-6774ec1254f9"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:18.987906 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-c4b8310d-5109-4f5d-b58b-52ed28e219be req-ab67fcd8-8bb5-4c6d-bf6d-da08c63d4bd6 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:18.988543 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-c4b8310d-5109-4f5d-b58b-52ed28e219be req-ab67fcd8-8bb5-4c6d-bf6d-da08c63d4bd6 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:19.003682 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-c4b8310d-5109-4f5d-b58b-52ed28e219be req-ab67fcd8-8bb5-4c6d-bf6d-da08c63d4bd6 service nova] Creating event network-vif-deleted:481a00ce-3877-4a82-887d-6774ec1254f9 for instance f7062eaf-78a1-4879-9edb-6465141472bc on hv-cinder-84488 Jul 12 18:30:19.009856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-c4b8310d-5109-4f5d-b58b-52ed28e219be req-ab67fcd8-8bb5-4c6d-bf6d-da08c63d4bd6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038617 Jul 12 18:30:19.010681 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 308/574] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:19.419440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-31a71f1a-0e30-45c3-a374-8f2100e3686f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:19.420425 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-31a71f1a-0e30-45c3-a374-8f2100e3686f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:19.428636 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-31a71f1a-0e30-45c3-a374-8f2100e3686f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:19.429300 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-31a71f1a-0e30-45c3-a374-8f2100e3686f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:19.431414 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-31a71f1a-0e30-45c3-a374-8f2100e3686f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:19.432362 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-31a71f1a-0e30-45c3-a374-8f2100e3686f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:19.514559 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-31a71f1a-0e30-45c3-a374-8f2100e3686f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:19.523254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-31a71f1a-0e30-45c3-a374-8f2100e3686f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1308 microversion: 2.1 time: 0.107899 Jul 12 18:30:19.524132 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 267/575] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:19 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:19.744177 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c0086737-64d0-484b-bfab-9d188c07dbd3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:19.744942 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c0086737-64d0-484b-bfab-9d188c07dbd3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:19.751742 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c0086737-64d0-484b-bfab-9d188c07dbd3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:19.752521 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c0086737-64d0-484b-bfab-9d188c07dbd3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:19.753469 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c0086737-64d0-484b-bfab-9d188c07dbd3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:19.754783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c0086737-64d0-484b-bfab-9d188c07dbd3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:19.772613 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:19.789902 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c0086737-64d0-484b-bfab-9d188c07dbd3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:19.790351 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c0086737-64d0-484b-bfab-9d188c07dbd3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:19.791009 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-c0086737-64d0-484b-bfab-9d188c07dbd3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lazy-loading 'fault' on Instance uuid f7062eaf-78a1-4879-9edb-6465141472bc {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:30:19.843278 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c0086737-64d0-484b-bfab-9d188c07dbd3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:19.846371 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c0086737-64d0-484b-bfab-9d188c07dbd3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 200 len: 1336 microversion: 2.1 time: 0.107360 Jul 12 18:30:19.847294 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 309/576] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:19 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 1336 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:20.541049 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-665d2303-b82d-46dd-948f-bac87c7d0c42 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:20.547490 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-665d2303-b82d-46dd-948f-bac87c7d0c42 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:20.548265 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-665d2303-b82d-46dd-948f-bac87c7d0c42 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:20.548762 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-665d2303-b82d-46dd-948f-bac87c7d0c42 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:20.549526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-665d2303-b82d-46dd-948f-bac87c7d0c42 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:20.549953 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-665d2303-b82d-46dd-948f-bac87c7d0c42 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:20.784531 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-665d2303-b82d-46dd-948f-bac87c7d0c42 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:20.793305 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-665d2303-b82d-46dd-948f-bac87c7d0c42 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1364 microversion: 2.1 time: 0.256154 Jul 12 18:30:20.793962 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 268/577] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:20 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:20.865284 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cd039684-ec36-4da7-890a-9577f4e732c4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:20.866568 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-cd039684-ec36-4da7-890a-9577f4e732c4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: f7062eaf-78a1-4879-9edb-6465141472bc] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:20.873839 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd039684-ec36-4da7-890a-9577f4e732c4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:20.874374 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd039684-ec36-4da7-890a-9577f4e732c4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:20.875222 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd039684-ec36-4da7-890a-9577f4e732c4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:20.875666 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd039684-ec36-4da7-890a-9577f4e732c4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:20.890862 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-cd039684-ec36-4da7-890a-9577f4e732c4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] HTTP exception thrown: Instance f7062eaf-78a1-4879-9edb-6465141472bc could not be found. Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cd039684-ec36-4da7-890a-9577f4e732c4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Request method failure captured: Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc HTTP/1.1 Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizbyL2WKceURQ3_ZkcC34Y0vnD-EGZVufCOFoKfl5xwD31kyWdLgUpvuGYIxbubmz0iOJIC4WFMxdHlep46gbhJgbTsNl3Yq4j2YqV9D8D_aI8PsDZQzyyWWsp3nGlRU1OVMHS9knyY1Zte5rKZdgNY1SWcmoFoIT8GbV17VwJP8_ZwY Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 54167aa5315d4dd2b514ad4b027634f9 Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:30:20.892744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_54167aa5315d4dd2b514ad4b027634f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 54167aa5315d4dd2b514ad4b027634f9 Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-ServerRescueNegativeTestJSON-1109686293-project Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: b58b0d520aa1418bb6ad3b5645a826a7 Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1109686293-project Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance f7062eaf-78a1-4879-9edb-6465141472bc could not be found. Jul 12 18:30:20.894306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': 'f7062eaf-78a1-4879-9edb-6465141472bc'} Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7062eaf-78a1-4879-9edb-6465141472bc could not be found. Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:30:20.895791 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7062eaf-78a1-4879-9edb-6465141472bc could not be found. Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7062eaf-78a1-4879-9edb-6465141472bc could not be found. Jul 12 18:30:20.897373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:30:20.898717 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cd039684-ec36-4da7-890a-9577f4e732c4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Returning 404 to user: Instance f7062eaf-78a1-4879-9edb-6465141472bc could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:30:20.898717 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-cd039684-ec36-4da7-890a-9577f4e732c4 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc" status: 404 len: 111 microversion: 2.1 time: 0.034478 Jul 12 18:30:20.898881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 310/578] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:20 2022] GET /compute/v2.1/servers/f7062eaf-78a1-4879-9edb-6465141472bc => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:30:20.907640 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f115c369-3127-4954-96bd-40da395763e3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '.version_select at 0x7f1bb14b2820>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:21.055039 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f115c369-3127-4954-96bd-40da395763e3 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1868441543" status: 202 len: 0 microversion: 2.1 time: 0.151170 Jul 12 18:30:21.055641 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 269/579] 10.222.0.47 () {58 vars in 1220 bytes} [Tue Jul 12 18:30:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1868441543 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:30:21.098395 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-4d262b5d-23d4-4f43-b031-d13f621f161e req-d9c020dd-bd9c-421c-b9ba-907aca170c05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7457d661-1f52-4e7d-b723-1f18292c5b9a", "tag": "ef01d3e7-224f-4391-8b4e-98debf0c76e6"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:21.111210 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-4d262b5d-23d4-4f43-b031-d13f621f161e req-d9c020dd-bd9c-421c-b9ba-907aca170c05 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:21.111662 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-4d262b5d-23d4-4f43-b031-d13f621f161e req-d9c020dd-bd9c-421c-b9ba-907aca170c05 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:21.142525 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-4d262b5d-23d4-4f43-b031-d13f621f161e req-d9c020dd-bd9c-421c-b9ba-907aca170c05 service nova] Creating event network-changed:ef01d3e7-224f-4391-8b4e-98debf0c76e6 for instance 7457d661-1f52-4e7d-b723-1f18292c5b9a on hv-cinder-84488 Jul 12 18:30:21.151437 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-4d262b5d-23d4-4f43-b031-d13f621f161e req-d9c020dd-bd9c-421c-b9ba-907aca170c05 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057839 Jul 12 18:30:21.152737 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 311/580] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:21.808120 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:21.810541 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=12 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:21.814876 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c33cbe9c-2f7e-429e-b121-00ae3cb4d7b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:21.815714 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c33cbe9c-2f7e-429e-b121-00ae3cb4d7b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:21.823169 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c33cbe9c-2f7e-429e-b121-00ae3cb4d7b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:21.823615 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c33cbe9c-2f7e-429e-b121-00ae3cb4d7b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:21.824410 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c33cbe9c-2f7e-429e-b121-00ae3cb4d7b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:21.824837 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c33cbe9c-2f7e-429e-b121-00ae3cb4d7b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:21.846317 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:22.089328 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c33cbe9c-2f7e-429e-b121-00ae3cb4d7b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:22.098924 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c33cbe9c-2f7e-429e-b121-00ae3cb4d7b1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1364 microversion: 2.1 time: 0.290886 Jul 12 18:30:22.104248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 270/581] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:21 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:23.121592 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0ce6e883-7fe6-4edf-bef0-8b52eb323983 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:23.122198 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0ce6e883-7fe6-4edf-bef0-8b52eb323983 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:23.124111 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=12 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:23.129385 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ce6e883-7fe6-4edf-bef0-8b52eb323983 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:23.129825 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ce6e883-7fe6-4edf-bef0-8b52eb323983 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:23.130751 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ce6e883-7fe6-4edf-bef0-8b52eb323983 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:23.131175 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ce6e883-7fe6-4edf-bef0-8b52eb323983 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:23.265600 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0ce6e883-7fe6-4edf-bef0-8b52eb323983 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:23.274045 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0ce6e883-7fe6-4edf-bef0-8b52eb323983 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1364 microversion: 2.1 time: 0.156787 Jul 12 18:30:23.274622 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 312/582] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:23 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:24.291506 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4c1d744c-8a07-4275-b286-6c7495459355 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:24.292106 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4c1d744c-8a07-4275-b286-6c7495459355 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:24.298950 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c1d744c-8a07-4275-b286-6c7495459355 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:24.299387 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c1d744c-8a07-4275-b286-6c7495459355 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:24.300151 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c1d744c-8a07-4275-b286-6c7495459355 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:24.300634 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c1d744c-8a07-4275-b286-6c7495459355 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:24.441572 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4c1d744c-8a07-4275-b286-6c7495459355 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:24.453185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4c1d744c-8a07-4275-b286-6c7495459355 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1364 microversion: 2.1 time: 0.165412 Jul 12 18:30:24.453781 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 271/583] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:24 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:25.230234 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8c700f12-7a28-4a9a-a3da-c4dfdc79a60f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:25.230817 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8c700f12-7a28-4a9a-a3da-c4dfdc79a60f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:25.237019 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8c700f12-7a28-4a9a-a3da-c4dfdc79a60f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:25.237724 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8c700f12-7a28-4a9a-a3da-c4dfdc79a60f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:25.238506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8c700f12-7a28-4a9a-a3da-c4dfdc79a60f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:25.239508 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8c700f12-7a28-4a9a-a3da-c4dfdc79a60f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:25.265637 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8c700f12-7a28-4a9a-a3da-c4dfdc79a60f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:30:25.524738 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-edc254c5-bd37-45df-adc6-b5090631f285 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:25.527044 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-edc254c5-bd37-45df-adc6-b5090631f285 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:25.531698 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-edc254c5-bd37-45df-adc6-b5090631f285 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:25.532141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-edc254c5-bd37-45df-adc6-b5090631f285 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:25.533866 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-edc254c5-bd37-45df-adc6-b5090631f285 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:25.533866 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-edc254c5-bd37-45df-adc6-b5090631f285 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:25.595286 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8c700f12-7a28-4a9a-a3da-c4dfdc79a60f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "DELETE /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 204 len: 0 microversion: 2.1 time: 0.368560 Jul 12 18:30:25.596050 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 313/584] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:30:25 2022] DELETE /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:30:25.606539 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0cbb8c48-1b3f-4996-9196-7b135c51bf73 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:25.607247 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0cbb8c48-1b3f-4996-9196-7b135c51bf73 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:25.614544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0cbb8c48-1b3f-4996-9196-7b135c51bf73 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:25.615318 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0cbb8c48-1b3f-4996-9196-7b135c51bf73 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:25.616189 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0cbb8c48-1b3f-4996-9196-7b135c51bf73 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:25.616660 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0cbb8c48-1b3f-4996-9196-7b135c51bf73 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:25.682357 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-edc254c5-bd37-45df-adc6-b5090631f285 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:25.690544 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-edc254c5-bd37-45df-adc6-b5090631f285 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1364 microversion: 2.1 time: 0.223264 Jul 12 18:30:25.691384 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 272/585] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:25 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:25.764804 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0cbb8c48-1b3f-4996-9196-7b135c51bf73 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:25.772895 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0cbb8c48-1b3f-4996-9196-7b135c51bf73 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1508 microversion: 2.1 time: 0.171075 Jul 12 18:30:25.773478 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 314/586] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:25 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:26.708423 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e98aef3f-48c7-49e2-9cdf-fb4366dbc0a7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:26.709041 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e98aef3f-48c7-49e2-9cdf-fb4366dbc0a7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:26.715814 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e98aef3f-48c7-49e2-9cdf-fb4366dbc0a7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:26.716261 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e98aef3f-48c7-49e2-9cdf-fb4366dbc0a7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:26.717059 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e98aef3f-48c7-49e2-9cdf-fb4366dbc0a7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:26.717491 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e98aef3f-48c7-49e2-9cdf-fb4366dbc0a7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:26.789978 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8e4d2d6a-6251-4da1-8c50-8ed14337d10a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:26.792153 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8e4d2d6a-6251-4da1-8c50-8ed14337d10a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:26.798085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8e4d2d6a-6251-4da1-8c50-8ed14337d10a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:26.798531 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8e4d2d6a-6251-4da1-8c50-8ed14337d10a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:26.799301 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8e4d2d6a-6251-4da1-8c50-8ed14337d10a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:26.799856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8e4d2d6a-6251-4da1-8c50-8ed14337d10a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:26.855337 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e98aef3f-48c7-49e2-9cdf-fb4366dbc0a7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:26.863790 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e98aef3f-48c7-49e2-9cdf-fb4366dbc0a7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1364 microversion: 2.1 time: 0.159635 Jul 12 18:30:26.864639 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 273/587] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:26 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:26.936166 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8e4d2d6a-6251-4da1-8c50-8ed14337d10a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:26.944928 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8e4d2d6a-6251-4da1-8c50-8ed14337d10a tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1508 microversion: 2.1 time: 0.158695 Jul 12 18:30:26.945552 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 315/588] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:26 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:27.882193 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d46d0bcc-b1eb-4a76-987e-ca7a2fb791d1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:27.883083 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d46d0bcc-b1eb-4a76-987e-ca7a2fb791d1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:27.890631 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d46d0bcc-b1eb-4a76-987e-ca7a2fb791d1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:27.891082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d46d0bcc-b1eb-4a76-987e-ca7a2fb791d1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:27.891873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d46d0bcc-b1eb-4a76-987e-ca7a2fb791d1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:27.892336 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d46d0bcc-b1eb-4a76-987e-ca7a2fb791d1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:27.943346 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-3f0e0f39-6f53-426a-8f90-7a41358f4da7 req-f8d8a093-a1df-44a8-bdc4-0e2718f24d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7457d661-1f52-4e7d-b723-1f18292c5b9a", "name": "network-vif-plugged", "status": "completed", "tag": "ef01d3e7-224f-4391-8b4e-98debf0c76e6"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:27.951994 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-3f0e0f39-6f53-426a-8f90-7a41358f4da7 req-f8d8a093-a1df-44a8-bdc4-0e2718f24d2d service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:27.952467 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-3f0e0f39-6f53-426a-8f90-7a41358f4da7 req-f8d8a093-a1df-44a8-bdc4-0e2718f24d2d service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:27.964866 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-3f0e0f39-6f53-426a-8f90-7a41358f4da7 req-f8d8a093-a1df-44a8-bdc4-0e2718f24d2d service nova] Creating event network-vif-plugged:ef01d3e7-224f-4391-8b4e-98debf0c76e6 for instance 7457d661-1f52-4e7d-b723-1f18292c5b9a on hv-cinder-84488 Jul 12 18:30:27.970118 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-3f0e0f39-6f53-426a-8f90-7a41358f4da7 req-f8d8a093-a1df-44a8-bdc4-0e2718f24d2d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031137 Jul 12 18:30:27.972535 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 316/589] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:27.977681 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-419e333b-8120-45de-935c-d0392aad35e2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:27.978467 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-419e333b-8120-45de-935c-d0392aad35e2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:27.985613 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-419e333b-8120-45de-935c-d0392aad35e2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:27.985613 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-419e333b-8120-45de-935c-d0392aad35e2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:27.986380 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-419e333b-8120-45de-935c-d0392aad35e2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:27.987016 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-419e333b-8120-45de-935c-d0392aad35e2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:28.054899 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d46d0bcc-b1eb-4a76-987e-ca7a2fb791d1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:28.063298 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d46d0bcc-b1eb-4a76-987e-ca7a2fb791d1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1364 microversion: 2.1 time: 0.185470 Jul 12 18:30:28.063883 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 274/590] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:27 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:28.139678 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-419e333b-8120-45de-935c-d0392aad35e2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:28.149072 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-419e333b-8120-45de-935c-d0392aad35e2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1508 microversion: 2.1 time: 0.177055 Jul 12 18:30:28.150009 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 317/591] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:27 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:28.758989 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-338912c1-744c-47b7-80a5-8b343a9dffdf req-d183bc03-111b-432d-b060-450b4cbd5a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39e09137-6e4f-49c6-b4ae-b22209297ca5", "name": "network-vif-deleted", "tag": "ea9e2834-7154-4f15-8e8a-4524e64f1d91"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:28.767419 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-338912c1-744c-47b7-80a5-8b343a9dffdf req-d183bc03-111b-432d-b060-450b4cbd5a60 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:28.767855 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-338912c1-744c-47b7-80a5-8b343a9dffdf req-d183bc03-111b-432d-b060-450b4cbd5a60 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:28.780010 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-338912c1-744c-47b7-80a5-8b343a9dffdf req-d183bc03-111b-432d-b060-450b4cbd5a60 service nova] Creating event network-vif-deleted:ea9e2834-7154-4f15-8e8a-4524e64f1d91 for instance 39e09137-6e4f-49c6-b4ae-b22209297ca5 on hv-cinder-84488 Jul 12 18:30:28.785137 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-338912c1-744c-47b7-80a5-8b343a9dffdf req-d183bc03-111b-432d-b060-450b4cbd5a60 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030815 Jul 12 18:30:28.785736 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 275/592] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:29.081010 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c6e5ecc1-0977-488a-8175-47a3928e7ba3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:29.081628 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c6e5ecc1-0977-488a-8175-47a3928e7ba3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:29.088157 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6e5ecc1-0977-488a-8175-47a3928e7ba3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:29.088633 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6e5ecc1-0977-488a-8175-47a3928e7ba3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:29.089401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6e5ecc1-0977-488a-8175-47a3928e7ba3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:29.089833 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c6e5ecc1-0977-488a-8175-47a3928e7ba3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:29.168169 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-dcbf7983-58ef-42ff-83e6-ed6d16a3b5bb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:29.169249 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-dcbf7983-58ef-42ff-83e6-ed6d16a3b5bb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:29.176041 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dcbf7983-58ef-42ff-83e6-ed6d16a3b5bb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:29.177062 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dcbf7983-58ef-42ff-83e6-ed6d16a3b5bb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:29.178047 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dcbf7983-58ef-42ff-83e6-ed6d16a3b5bb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:29.178471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dcbf7983-58ef-42ff-83e6-ed6d16a3b5bb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:29.233852 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c6e5ecc1-0977-488a-8175-47a3928e7ba3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:29.243132 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c6e5ecc1-0977-488a-8175-47a3928e7ba3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1364 microversion: 2.1 time: 0.165819 Jul 12 18:30:29.243734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 318/593] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:29 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:29.247938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dcbf7983-58ef-42ff-83e6-ed6d16a3b5bb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:29.256678 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-dcbf7983-58ef-42ff-83e6-ed6d16a3b5bb tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1293 microversion: 2.1 time: 0.093622 Jul 12 18:30:29.257285 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 276/594] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:29 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:30.261086 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d7e61733-67fb-4690-b39a-5c1292cef45a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:30.261761 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d7e61733-67fb-4690-b39a-5c1292cef45a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:30.271605 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d7e61733-67fb-4690-b39a-5c1292cef45a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:30.271605 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d7e61733-67fb-4690-b39a-5c1292cef45a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:30.271605 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d7e61733-67fb-4690-b39a-5c1292cef45a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:30.271605 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d7e61733-67fb-4690-b39a-5c1292cef45a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:30.274626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e01cb00f-9d29-42ad-b2bc-eb73da3f97b2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:30.275231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e01cb00f-9d29-42ad-b2bc-eb73da3f97b2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:30.278205 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:30.285191 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e01cb00f-9d29-42ad-b2bc-eb73da3f97b2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:30.285676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e01cb00f-9d29-42ad-b2bc-eb73da3f97b2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:30.286477 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e01cb00f-9d29-42ad-b2bc-eb73da3f97b2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:30.286903 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e01cb00f-9d29-42ad-b2bc-eb73da3f97b2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:30.320810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e01cb00f-9d29-42ad-b2bc-eb73da3f97b2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:30.321249 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e01cb00f-9d29-42ad-b2bc-eb73da3f97b2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:30.321693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-e01cb00f-9d29-42ad-b2bc-eb73da3f97b2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lazy-loading 'fault' on Instance uuid 39e09137-6e4f-49c6-b4ae-b22209297ca5 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:30:30.375165 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e01cb00f-9d29-42ad-b2bc-eb73da3f97b2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:30.377051 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e01cb00f-9d29-42ad-b2bc-eb73da3f97b2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 200 len: 1312 microversion: 2.1 time: 0.107608 Jul 12 18:30:30.377651 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 277/595] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:30 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:30.635082 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d7e61733-67fb-4690-b39a-5c1292cef45a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:30.642474 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d7e61733-67fb-4690-b39a-5c1292cef45a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1364 microversion: 2.1 time: 0.385330 Jul 12 18:30:30.644263 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 319/596] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:30 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1364 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:31.395932 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fd031abd-a5d0-4f98-99e8-f448cffa08a2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:31.396665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fd031abd-a5d0-4f98-99e8-f448cffa08a2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: 39e09137-6e4f-49c6-b4ae-b22209297ca5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:31.403921 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd031abd-a5d0-4f98-99e8-f448cffa08a2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:31.404392 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd031abd-a5d0-4f98-99e8-f448cffa08a2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:31.405177 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd031abd-a5d0-4f98-99e8-f448cffa08a2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:31.405659 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd031abd-a5d0-4f98-99e8-f448cffa08a2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:31.422197 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-fd031abd-a5d0-4f98-99e8-f448cffa08a2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] HTTP exception thrown: Instance 39e09137-6e4f-49c6-b4ae-b22209297ca5 could not be found. Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fd031abd-a5d0-4f98-99e8-f448cffa08a2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Request method failure captured: Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 HTTP/1.1 Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyL2WKceURQ3_ZkcC34Y0vnD-EGZVufCOFoKfl5xwD31kyWdLgUpvuGYIxbubmz0iOJIC4WFMxdHlep46gbhJgbTsNl3Yq4j2YqV9D8D_aI8PsDZQzyyWWsp3nGlRU1OVMHS9knyY1Zte5rKZdgNY1SWcmoFoIT8GbV17VwJP8_ZwY Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 54167aa5315d4dd2b514ad4b027634f9 Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:30:31.424775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_54167aa5315d4dd2b514ad4b027634f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 54167aa5315d4dd2b514ad4b027634f9 Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-ServerRescueNegativeTestJSON-1109686293-project Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: b58b0d520aa1418bb6ad3b5645a826a7 Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1109686293-project Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 39e09137-6e4f-49c6-b4ae-b22209297ca5 could not be found. Jul 12 18:30:31.426638 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '39e09137-6e4f-49c6-b4ae-b22209297ca5'} Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39e09137-6e4f-49c6-b4ae-b22209297ca5 could not be found. Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:30:31.427608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39e09137-6e4f-49c6-b4ae-b22209297ca5 could not be found. Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39e09137-6e4f-49c6-b4ae-b22209297ca5 could not be found. Jul 12 18:30:31.429537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:31.431084 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fd031abd-a5d0-4f98-99e8-f448cffa08a2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Returning 404 to user: Instance 39e09137-6e4f-49c6-b4ae-b22209297ca5 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:30:31.431084 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fd031abd-a5d0-4f98-99e8-f448cffa08a2 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5" status: 404 len: 111 microversion: 2.1 time: 0.035255 Jul 12 18:30:31.431084 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 278/597] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:31 2022] GET /compute/v2.1/servers/39e09137-6e4f-49c6-b4ae-b22209297ca5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:30:31.438572 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-20cdd1f8-a3f0-4bb9-8b89-3156e9346158 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:31.439427 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-20cdd1f8-a3f0-4bb9-8b89-3156e9346158 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:31.447951 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20cdd1f8-a3f0-4bb9-8b89-3156e9346158 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:31.453658 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20cdd1f8-a3f0-4bb9-8b89-3156e9346158 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:31.453658 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20cdd1f8-a3f0-4bb9-8b89-3156e9346158 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:31.453658 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-20cdd1f8-a3f0-4bb9-8b89-3156e9346158 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:31.477323 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-20cdd1f8-a3f0-4bb9-8b89-3156e9346158 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:30:31.661778 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a1bd20b8-9dde-499a-b766-0cd374bb8571 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:31.662302 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a1bd20b8-9dde-499a-b766-0cd374bb8571 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:31.669913 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1bd20b8-9dde-499a-b766-0cd374bb8571 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:31.670360 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1bd20b8-9dde-499a-b766-0cd374bb8571 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:31.671134 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1bd20b8-9dde-499a-b766-0cd374bb8571 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:31.671565 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1bd20b8-9dde-499a-b766-0cd374bb8571 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:31.814749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a1bd20b8-9dde-499a-b766-0cd374bb8571 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:31.824734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a1bd20b8-9dde-499a-b766-0cd374bb8571 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1549 microversion: 2.1 time: 0.167801 Jul 12 18:30:31.825792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 279/598] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:31 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:31.830588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-20cdd1f8-a3f0-4bb9-8b89-3156e9346158 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 204 len: 0 microversion: 2.1 time: 0.396859 Jul 12 18:30:31.834078 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 320/599] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:30:31 2022] DELETE /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:30:31.845519 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-eff538c0-3764-4c9b-ad47-66ab34f8d648 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:31.846806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-eff538c0-3764-4c9b-ad47-66ab34f8d648 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:31.849097 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e112057d-57d7-42ca-a4d3-74e908fe0db1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:31.854912 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e112057d-57d7-42ca-a4d3-74e908fe0db1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:31.855571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e112057d-57d7-42ca-a4d3-74e908fe0db1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:31.856055 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e112057d-57d7-42ca-a4d3-74e908fe0db1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:31.856871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e112057d-57d7-42ca-a4d3-74e908fe0db1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:31.857337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e112057d-57d7-42ca-a4d3-74e908fe0db1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:31.858002 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eff538c0-3764-4c9b-ad47-66ab34f8d648 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:31.858757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eff538c0-3764-4c9b-ad47-66ab34f8d648 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:31.860044 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eff538c0-3764-4c9b-ad47-66ab34f8d648 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:31.860893 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eff538c0-3764-4c9b-ad47-66ab34f8d648 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:31.941358 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e112057d-57d7-42ca-a4d3-74e908fe0db1 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097059 Jul 12 18:30:31.942429 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 321/600] 10.222.0.47 () {58 vars in 1274 bytes} [Tue Jul 12 18:30:31 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:30:32.038930 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-eff538c0-3764-4c9b-ad47-66ab34f8d648 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:32.047546 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-eff538c0-3764-4c9b-ad47-66ab34f8d648 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.209086 Jul 12 18:30:32.048119 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 280/601] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:31 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:33.061747 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-da27e5a8-9d83-4ad2-a3e7-88f45bacc82e req-bcb838ba-c3df-42cb-acf8-2ec9b1f326f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7457d661-1f52-4e7d-b723-1f18292c5b9a", "tag": "ef01d3e7-224f-4391-8b4e-98debf0c76e6"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:33.068401 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bf29f765-8290-43e2-b4e2-325d8b1cdc0c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:33.069742 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bf29f765-8290-43e2-b4e2-325d8b1cdc0c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:33.070952 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-da27e5a8-9d83-4ad2-a3e7-88f45bacc82e req-bcb838ba-c3df-42cb-acf8-2ec9b1f326f8 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:33.071627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-da27e5a8-9d83-4ad2-a3e7-88f45bacc82e req-bcb838ba-c3df-42cb-acf8-2ec9b1f326f8 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:33.076347 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf29f765-8290-43e2-b4e2-325d8b1cdc0c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:33.077070 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf29f765-8290-43e2-b4e2-325d8b1cdc0c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:33.078225 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf29f765-8290-43e2-b4e2-325d8b1cdc0c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:33.078653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf29f765-8290-43e2-b4e2-325d8b1cdc0c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:33.084792 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-da27e5a8-9d83-4ad2-a3e7-88f45bacc82e req-bcb838ba-c3df-42cb-acf8-2ec9b1f326f8 service nova] Creating event network-changed:ef01d3e7-224f-4391-8b4e-98debf0c76e6 for instance 7457d661-1f52-4e7d-b723-1f18292c5b9a on hv-cinder-84488 Jul 12 18:30:33.090194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-da27e5a8-9d83-4ad2-a3e7-88f45bacc82e req-bcb838ba-c3df-42cb-acf8-2ec9b1f326f8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032024 Jul 12 18:30:33.090902 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 322/602] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:30:33.237841 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bf29f765-8290-43e2-b4e2-325d8b1cdc0c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:33.245717 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bf29f765-8290-43e2-b4e2-325d8b1cdc0c tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.184481 Jul 12 18:30:33.246309 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 281/603] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:33 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:34.264752 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-39e61a27-048d-4f8a-b4f1-e00f6c71aabc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:34.265355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-39e61a27-048d-4f8a-b4f1-e00f6c71aabc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:34.272714 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-39e61a27-048d-4f8a-b4f1-e00f6c71aabc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:34.273246 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-39e61a27-048d-4f8a-b4f1-e00f6c71aabc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:34.274139 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-39e61a27-048d-4f8a-b4f1-e00f6c71aabc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:34.274582 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-39e61a27-048d-4f8a-b4f1-e00f6c71aabc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:34.437640 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-39e61a27-048d-4f8a-b4f1-e00f6c71aabc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:34.447078 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-39e61a27-048d-4f8a-b4f1-e00f6c71aabc tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.187060 Jul 12 18:30:34.448049 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 323/604] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:34 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:35.464862 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5033f6e0-4beb-4a27-9b25-ad23e7f9ca79 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:35.465665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5033f6e0-4beb-4a27-9b25-ad23e7f9ca79 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:35.473293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5033f6e0-4beb-4a27-9b25-ad23e7f9ca79 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:35.473293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5033f6e0-4beb-4a27-9b25-ad23e7f9ca79 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:35.474044 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5033f6e0-4beb-4a27-9b25-ad23e7f9ca79 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:35.474475 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5033f6e0-4beb-4a27-9b25-ad23e7f9ca79 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:35.734901 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5033f6e0-4beb-4a27-9b25-ad23e7f9ca79 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:35.743780 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5033f6e0-4beb-4a27-9b25-ad23e7f9ca79 tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1521 microversion: 2.1 time: 0.282959 Jul 12 18:30:35.744401 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 282/605] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:35 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:35.893143 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-282c0e37-1dec-42a2-81fb-3eb948a8f37e req-ac9679b6-73f7-4c8f-a298-3eb824573ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b08a5b52-4e63-4914-b23c-3818819f7890", "name": "network-vif-deleted", "tag": "f7fc27cc-a730-4429-a8a5-fde8e8b27309"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:35.902994 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-282c0e37-1dec-42a2-81fb-3eb948a8f37e req-ac9679b6-73f7-4c8f-a298-3eb824573ba1 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:35.903831 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-282c0e37-1dec-42a2-81fb-3eb948a8f37e req-ac9679b6-73f7-4c8f-a298-3eb824573ba1 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:35.917022 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-282c0e37-1dec-42a2-81fb-3eb948a8f37e req-ac9679b6-73f7-4c8f-a298-3eb824573ba1 service nova] Creating event network-vif-deleted:f7fc27cc-a730-4429-a8a5-fde8e8b27309 for instance b08a5b52-4e63-4914-b23c-3818819f7890 on hv-cinder-84488 Jul 12 18:30:35.922119 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-282c0e37-1dec-42a2-81fb-3eb948a8f37e req-ac9679b6-73f7-4c8f-a298-3eb824573ba1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032794 Jul 12 18:30:35.922744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 324/606] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:36.763282 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5cb5c7c1-cc08-48c6-a46a-756aba22e32f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:36.763900 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5cb5c7c1-cc08-48c6-a46a-756aba22e32f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:36.772759 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7c1-cc08-48c6-a46a-756aba22e32f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:36.780527 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7c1-cc08-48c6-a46a-756aba22e32f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:36.780527 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7c1-cc08-48c6-a46a-756aba22e32f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:36.780527 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7c1-cc08-48c6-a46a-756aba22e32f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:36.807475 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7c1-cc08-48c6-a46a-756aba22e32f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:36.808009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cb5c7c1-cc08-48c6-a46a-756aba22e32f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:36.808637 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-5cb5c7c1-cc08-48c6-a46a-756aba22e32f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lazy-loading 'fault' on Instance uuid b08a5b52-4e63-4914-b23c-3818819f7890 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:30:36.857683 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5cb5c7c1-cc08-48c6-a46a-756aba22e32f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b0d520aa1418bb6ad3b5645a826a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54167aa5315d4dd2b514ad4b027634f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:36.865832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5cb5c7c1-cc08-48c6-a46a-756aba22e32f tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 200 len: 1311 microversion: 2.1 time: 0.106472 Jul 12 18:30:36.866484 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 283/607] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:36 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:37.889470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d1e67efa-55bc-4d91-92c5-c96694bb921e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:37.890183 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d1e67efa-55bc-4d91-92c5-c96694bb921e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] [instance: b08a5b52-4e63-4914-b23c-3818819f7890] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:37.898385 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d1e67efa-55bc-4d91-92c5-c96694bb921e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:37.899006 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d1e67efa-55bc-4d91-92c5-c96694bb921e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:37.899849 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d1e67efa-55bc-4d91-92c5-c96694bb921e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:37.900284 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d1e67efa-55bc-4d91-92c5-c96694bb921e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:37.915428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-d1e67efa-55bc-4d91-92c5-c96694bb921e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] HTTP exception thrown: Instance b08a5b52-4e63-4914-b23c-3818819f7890 could not be found. Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d1e67efa-55bc-4d91-92c5-c96694bb921e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Request method failure captured: Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 HTTP/1.1 Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizbyL2WKceURQ3_ZkcC34Y0vnD-EGZVufCOFoKfl5xwD31kyWdLgUpvuGYIxbubmz0iOJIC4WFMxdHlep46gbhJgbTsNl3Yq4j2YqV9D8D_aI8PsDZQzyyWWsp3nGlRU1OVMHS9knyY1Zte5rKZdgNY1SWcmoFoIT8GbV17VwJP8_ZwY Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 54167aa5315d4dd2b514ad4b027634f9 Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:30:37.917573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_54167aa5315d4dd2b514ad4b027634f9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54167aa5315d4dd2b514ad4b027634f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 54167aa5315d4dd2b514ad4b027634f9 Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1109686293 Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-ServerRescueNegativeTestJSON-1109686293-project Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: b58b0d520aa1418bb6ad3b5645a826a7 Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1109686293-project Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance b08a5b52-4e63-4914-b23c-3818819f7890 could not be found. Jul 12 18:30:37.937262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': 'b08a5b52-4e63-4914-b23c-3818819f7890'} Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b08a5b52-4e63-4914-b23c-3818819f7890 could not be found. Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:30:37.938940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b08a5b52-4e63-4914-b23c-3818819f7890 could not be found. Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b08a5b52-4e63-4914-b23c-3818819f7890 could not be found. Jul 12 18:30:37.940373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:30:37.942956 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d1e67efa-55bc-4d91-92c5-c96694bb921e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] Returning 404 to user: Instance b08a5b52-4e63-4914-b23c-3818819f7890 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:30:37.942956 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d1e67efa-55bc-4d91-92c5-c96694bb921e tempest-ServerRescueNegativeTestJSON-1109686293 tempest-ServerRescueNegativeTestJSON-1109686293-project] 10.222.0.47 "GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890" status: 404 len: 111 microversion: 2.1 time: 0.033737 Jul 12 18:30:37.942956 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 325/608] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:37 2022] GET /compute/v2.1/servers/b08a5b52-4e63-4914-b23c-3818819f7890 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:30:43.444866 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-dc510ee9-3b94-4bfe-9536-0d22f55253be tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1717293275"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:43.445432 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-dc510ee9-3b94-4bfe-9536-0d22f55253be tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:43.452665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc510ee9-3b94-4bfe-9536-0d22f55253be tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:43.453110 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc510ee9-3b94-4bfe-9536-0d22f55253be tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:43.453917 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc510ee9-3b94-4bfe-9536-0d22f55253be tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:43.454354 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc510ee9-3b94-4bfe-9536-0d22f55253be tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:43.602313 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.network.security_group_api [None req-dc510ee9-3b94-4bfe-9536-0d22f55253be tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Removing security group 4fafd82f-3a1c-40b5-b138-8880ed043fe8 from port 6becd9b8-f6f0-4c1e-8ce2-67eb379069f7 Jul 12 18:30:44.118049 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-dc510ee9-3b94-4bfe-9536-0d22f55253be tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "POST /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/action" status: 202 len: 0 microversion: 2.1 time: 0.677993 Jul 12 18:30:44.123801 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 284/609] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:30:43 2022] POST /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:30:44.387348 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-90621b89-5edd-4cf8-8295-6e0e9dd4d505 req-960f383b-e854-4fb7-998f-2af769d3a411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c546fb53-6e12-426c-99a6-e6264514203d", "tag": "6becd9b8-f6f0-4c1e-8ce2-67eb379069f7"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:44.399136 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:44.401859 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-90621b89-5edd-4cf8-8295-6e0e9dd4d505 req-960f383b-e854-4fb7-998f-2af769d3a411 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:44.402551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-90621b89-5edd-4cf8-8295-6e0e9dd4d505 req-960f383b-e854-4fb7-998f-2af769d3a411 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:44.442919 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-90621b89-5edd-4cf8-8295-6e0e9dd4d505 req-960f383b-e854-4fb7-998f-2af769d3a411 service nova] Creating event network-changed:6becd9b8-f6f0-4c1e-8ce2-67eb379069f7 for instance c546fb53-6e12-426c-99a6-e6264514203d on hv-cinder-84488 Jul 12 18:30:44.463327 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-90621b89-5edd-4cf8-8295-6e0e9dd4d505 req-960f383b-e854-4fb7-998f-2af769d3a411 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.334381 Jul 12 18:30:44.471174 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 326/610] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:45.807610 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3e2a5f96-e077-4f2b-90b1-0da7b3e1f423 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:45.808229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3e2a5f96-e077-4f2b-90b1-0da7b3e1f423 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:45.820437 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e2a5f96-e077-4f2b-90b1-0da7b3e1f423 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:45.820908 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e2a5f96-e077-4f2b-90b1-0da7b3e1f423 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:45.821882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e2a5f96-e077-4f2b-90b1-0da7b3e1f423 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:45.822560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e2a5f96-e077-4f2b-90b1-0da7b3e1f423 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:45.958357 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-3e2a5f96-e077-4f2b-90b1-0da7b3e1f423 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lazy-loading 'services' on Instance uuid c546fb53-6e12-426c-99a6-e6264514203d {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:30:46.327719 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3e2a5f96-e077-4f2b-90b1-0da7b3e1f423 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments/4af5c7b4-5004-4451-8b01-28ea9d66bae4" status: 202 len: 0 microversion: 2.1 time: 0.525761 Jul 12 18:30:46.331469 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 285/611] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:30:45 2022] DELETE /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments/4af5c7b4-5004-4451-8b01-28ea9d66bae4 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:30:46.343978 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3123daff-0a64-411f-8206-13fea9ac7c8c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:46.346525 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3123daff-0a64-411f-8206-13fea9ac7c8c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:46.358303 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3123daff-0a64-411f-8206-13fea9ac7c8c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:46.358995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3123daff-0a64-411f-8206-13fea9ac7c8c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:46.360012 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3123daff-0a64-411f-8206-13fea9ac7c8c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:46.360655 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3123daff-0a64-411f-8206-13fea9ac7c8c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:46.378509 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:46.403302 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3123daff-0a64-411f-8206-13fea9ac7c8c tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069836 Jul 12 18:30:46.404749 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 327/612] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:30:46 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:30:46.496062 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-890ed32e-a14d-4727-a848-a71202a01b69 req-285c0220-6d38-4a41-be84-eca05044fb61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c546fb53-6e12-426c-99a6-e6264514203d", "tag": "6becd9b8-f6f0-4c1e-8ce2-67eb379069f7"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:46.506454 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-890ed32e-a14d-4727-a848-a71202a01b69 req-285c0220-6d38-4a41-be84-eca05044fb61 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:46.507233 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-890ed32e-a14d-4727-a848-a71202a01b69 req-285c0220-6d38-4a41-be84-eca05044fb61 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:46.522711 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-890ed32e-a14d-4727-a848-a71202a01b69 req-285c0220-6d38-4a41-be84-eca05044fb61 service nova] Creating event network-changed:6becd9b8-f6f0-4c1e-8ce2-67eb379069f7 for instance c546fb53-6e12-426c-99a6-e6264514203d on hv-cinder-84488 Jul 12 18:30:46.529950 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-890ed32e-a14d-4727-a848-a71202a01b69 req-285c0220-6d38-4a41-be84-eca05044fb61 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053476 Jul 12 18:30:46.531158 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 286/613] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:47.291355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-eb6d8e79-a569-48ff-a8ee-0e624c1cd75c tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] Calling method '.version_select at 0x7f1bb0be5310>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:47.361787 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-eb6d8e79-a569-48ff-a8ee-0e624c1cd75c tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3d1ded56-702d-4170-aa57-d2170664be7a" status: 200 len: 350 microversion: 2.1 time: 0.077063 Jul 12 18:30:47.363988 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 328/614] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:30:47 2022] GET /compute/v2.1/os-volumes/3d1ded56-702d-4170-aa57-d2170664be7a => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:47.419296 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-40bb6037-785b-4cf8-b579-6e63548b26ec tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:47.420293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-40bb6037-785b-4cf8-b579-6e63548b26ec tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:47.428295 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-40bb6037-785b-4cf8-b579-6e63548b26ec tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:47.429293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-40bb6037-785b-4cf8-b579-6e63548b26ec tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:47.430254 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-40bb6037-785b-4cf8-b579-6e63548b26ec tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:47.430902 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-40bb6037-785b-4cf8-b579-6e63548b26ec tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:47.469271 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-40bb6037-785b-4cf8-b579-6e63548b26ec tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054828 Jul 12 18:30:47.470405 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 287/615] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:30:47 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:30:48.481884 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5a059d7e-975c-4721-b146-a0db5e0163b4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:48.482721 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5a059d7e-975c-4721-b146-a0db5e0163b4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:48.490308 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5a059d7e-975c-4721-b146-a0db5e0163b4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:48.490745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5a059d7e-975c-4721-b146-a0db5e0163b4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:48.491511 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5a059d7e-975c-4721-b146-a0db5e0163b4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:48.491942 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5a059d7e-975c-4721-b146-a0db5e0163b4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:48.521389 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5a059d7e-975c-4721-b146-a0db5e0163b4 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043509 Jul 12 18:30:48.521957 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 329/616] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:30:48 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:30:48.531933 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6cb7be43-1b75-4b70-8906-13d35696c021 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:48.532489 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6cb7be43-1b75-4b70-8906-13d35696c021 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:48.539348 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cb7be43-1b75-4b70-8906-13d35696c021 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:48.539786 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cb7be43-1b75-4b70-8906-13d35696c021 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:48.540592 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cb7be43-1b75-4b70-8906-13d35696c021 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:48.541016 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cb7be43-1b75-4b70-8906-13d35696c021 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:48.543840 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:48.619604 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-6cb7be43-1b75-4b70-8906-13d35696c021 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] HTTP exception thrown: Instance c546fb53-6e12-426c-99a6-e6264514203d is not attached to volume 4af5c7b4-5004-4451-8b01-28ea9d66bae4 Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6cb7be43-1b75-4b70-8906-13d35696c021 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Request method failure captured: Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments/4af5c7b4-5004-4451-8b01-28ea9d66bae4 HTTP/1.1 Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb0Z2UQRA-D2Xs2cz0ajRAAnmaLs3A1T7_Z-rVi42lzUPeX8NgJjpikqa-xDymrtqxfbJCi9JtxNK_bAkSbNAcAskyjKbgdnDx-3LlrwBqjbLuwXgfRPZRyToGpfKd-f7T3ae9kxg34QipORqadX2jnwUjeOPj2BQb3MGj7fuuy5rmk Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: c9b591880e9441acac9ddf006a5f9959 Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-TestMinimumBasicScenario-1417366020 Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:30:48.622009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:30:48.623882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c9b591880e9441acac9ddf006a5f9959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c9b591880e9441acac9ddf006a5f9959"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c9b591880e9441acac9ddf006a5f9959", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c9b591880e9441acac9ddf006a5f9959"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:30:48.623882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-TestMinimumBasicScenario-1417366020 Jul 12 18:30:48.623882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: c9b591880e9441acac9ddf006a5f9959 Jul 12 18:30:48.623882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1417366020 Jul 12 18:30:48.623882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-TestMinimumBasicScenario-1417366020-project Jul 12 18:30:48.623882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:30:48.623882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:30:48.623882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 0e36c7fd357044ccbb59bddd12b61149 Jul 12 18:30:48.623882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-TestMinimumBasicScenario-1417366020-project Jul 12 18:30:48.623882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:30:48.623882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance c546fb53-6e12-426c-99a6-e6264514203d is not attached to volume 4af5c7b4-5004-4451-8b01-28ea9d66bae4 Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'server_id': 'c546fb53-6e12-426c-99a6-e6264514203d', 'id': '4af5c7b4-5004-4451-8b01-28ea9d66bae4'} Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4af5c7b4-5004-4451-8b01-28ea9d66bae4. Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:30:48.624873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c546fb53-6e12-426c-99a6-e6264514203d is not attached to volume 4af5c7b4-5004-4451-8b01-28ea9d66bae4 Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c546fb53-6e12-426c-99a6-e6264514203d is not attached to volume 4af5c7b4-5004-4451-8b01-28ea9d66bae4 Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:48.626258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6cb7be43-1b75-4b70-8906-13d35696c021 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Returning 404 to user: Instance c546fb53-6e12-426c-99a6-e6264514203d is not attached to volume 4af5c7b4-5004-4451-8b01-28ea9d66bae4 {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:30:48.627333 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6cb7be43-1b75-4b70-8906-13d35696c021 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments/4af5c7b4-5004-4451-8b01-28ea9d66bae4" status: 404 len: 154 microversion: 2.1 time: 0.095527 Jul 12 18:30:48.627333 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 288/617] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:30:48 2022] DELETE /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d/os-volume_attachments/4af5c7b4-5004-4451-8b01-28ea9d66bae4 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:30:49.086786 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1e218cab-4801-46f0-92b4-e2698e7cead0 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] Calling method '.version_select at 0x7f1bb0d6f9d0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:49.138899 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1e218cab-4801-46f0-92b4-e2698e7cead0 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/a0147894-04be-4034-9a28-824cf58c2dd4" status: 200 len: 351 microversion: 2.1 time: 0.057367 Jul 12 18:30:49.139475 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 330/618] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:30:49 2022] GET /compute/v2.1/os-volumes/a0147894-04be-4034-9a28-824cf58c2dd4 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:30:49.942761 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-db387cb5-c8e0-4663-a6b1-5d11543cbed3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:49.943320 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-db387cb5-c8e0-4663-a6b1-5d11543cbed3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:49.950238 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db387cb5-c8e0-4663-a6b1-5d11543cbed3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:49.950683 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db387cb5-c8e0-4663-a6b1-5d11543cbed3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:49.951451 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db387cb5-c8e0-4663-a6b1-5d11543cbed3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:49.951880 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db387cb5-c8e0-4663-a6b1-5d11543cbed3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:49.981202 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-db387cb5-c8e0-4663-a6b1-5d11543cbed3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:30:50.303936 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-db387cb5-c8e0-4663-a6b1-5d11543cbed3 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 204 len: 0 microversion: 2.1 time: 0.365470 Jul 12 18:30:50.304729 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 289/619] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:30:49 2022] DELETE /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:30:50.312976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c9444dc2-bcac-4c22-a2d4-7c04ac7f38b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:50.313577 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c9444dc2-bcac-4c22-a2d4-7c04ac7f38b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:50.320223 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c9444dc2-bcac-4c22-a2d4-7c04ac7f38b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:50.320697 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c9444dc2-bcac-4c22-a2d4-7c04ac7f38b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:50.321468 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c9444dc2-bcac-4c22-a2d4-7c04ac7f38b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:50.321902 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c9444dc2-bcac-4c22-a2d4-7c04ac7f38b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:50.459882 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c9444dc2-bcac-4c22-a2d4-7c04ac7f38b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:50.472366 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c9444dc2-bcac-4c22-a2d4-7c04ac7f38b8 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1555 microversion: 2.1 time: 0.159117 Jul 12 18:30:50.472366 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 331/620] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:50 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:50.802560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bbcf492b-9308-4407-b2c6-fcc8824e6808 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] Calling method '.version_select at 0x7f1bb14b2820>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:50.852889 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bbcf492b-9308-4407-b2c6-fcc8824e6808 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/24f2f343-c035-4e56-a6af-5ff92cd4ddff" status: 200 len: 351 microversion: 2.1 time: 0.054440 Jul 12 18:30:50.853465 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 290/621] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:30:50 2022] GET /compute/v2.1/os-volumes/24f2f343-c035-4e56-a6af-5ff92cd4ddff => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:50.864828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b534557f-782d-47ab-8bd8-1fd7fe9df57d tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] Calling method '.version_select at 0x7f1bb0ac24c0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:50.947098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b534557f-782d-47ab-8bd8-1fd7fe9df57d tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086330 Jul 12 18:30:50.947665 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 332/622] 10.222.0.47 () {58 vars in 1133 bytes} [Tue Jul 12 18:30:50 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:50.961044 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b52cc303-247c-452c-a444-30a487f29f98 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] Calling method '.version_select at 0x7f1bb09d38b0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:51.046108 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b52cc303-247c-452c-a444-30a487f29f98 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089919 Jul 12 18:30:51.046675 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 291/623] 10.222.0.47 () {58 vars in 1148 bytes} [Tue Jul 12 18:30:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:51.058827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5c6a5839-fd9b-4c1f-91c8-3acb5d31e888 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] Calling method '.version_select at 0x7f1bb0bef5e0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:51.141423 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5c6a5839-fd9b-4c1f-91c8-3acb5d31e888 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086307 Jul 12 18:30:51.141998 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 333/624] 10.222.0.47 () {58 vars in 1133 bytes} [Tue Jul 12 18:30:51 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:51.153809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-01129974-1783-4a76-b0b3-4be7f20d1ffc tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] Calling method '.version_select at 0x7f1bb09d39d0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:51.236801 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-01129974-1783-4a76-b0b3-4be7f20d1ffc tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086587 Jul 12 18:30:51.237362 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 292/625] 10.222.0.47 () {58 vars in 1166 bytes} [Tue Jul 12 18:30:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:51.249146 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f4017fe7-720d-4519-9bc2-c2fe42f00831 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] Calling method '.version_select at 0x7f1bb0aab5e0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:51.333133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f4017fe7-720d-4519-9bc2-c2fe42f00831 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087648 Jul 12 18:30:51.333836 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 334/626] 10.222.0.47 () {58 vars in 1169 bytes} [Tue Jul 12 18:30:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:51.347077 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-25cd9181-3e50-4d2f-aa00-31632141ea17 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] Calling method '.version_select at 0x7f1bb14aae50>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:51.429884 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-25cd9181-3e50-4d2f-aa00-31632141ea17 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086524 Jul 12 18:30:51.430467 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 293/627] 10.222.0.47 () {58 vars in 1154 bytes} [Tue Jul 12 18:30:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:51.443034 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6f439f15-a70e-449f-8d65-347a96369a72 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] Calling method '.version_select at 0x7f1bb0aabca0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:51.486263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-76d61693-2a87-4eff-8095-7e6e06b43406 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:51.487007 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-76d61693-2a87-4eff-8095-7e6e06b43406 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:51.495857 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-76d61693-2a87-4eff-8095-7e6e06b43406 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:51.496300 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-76d61693-2a87-4eff-8095-7e6e06b43406 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:51.497161 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-76d61693-2a87-4eff-8095-7e6e06b43406 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:51.497646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-76d61693-2a87-4eff-8095-7e6e06b43406 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:51.535334 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6f439f15-a70e-449f-8d65-347a96369a72 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097098 Jul 12 18:30:51.545915 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 335/628] 10.222.0.47 () {58 vars in 1187 bytes} [Tue Jul 12 18:30:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:51.553442 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-686889bd-651b-4627-8431-02eb34d25de0 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] Calling method '.version_select at 0x7f1bb0befa60>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:51.640976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-686889bd-651b-4627-8431-02eb34d25de0 tempest-VolumesTestJSON-950237737 tempest-VolumesTestJSON-950237737-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.093058 Jul 12 18:30:51.641574 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 336/629] 10.222.0.47 () {58 vars in 1154 bytes} [Tue Jul 12 18:30:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:51.650244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-76d61693-2a87-4eff-8095-7e6e06b43406 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:51.658727 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-76d61693-2a87-4eff-8095-7e6e06b43406 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1555 microversion: 2.1 time: 0.176342 Jul 12 18:30:51.661929 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 294/630] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:51 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:30:52.676811 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-aee4c385-5dda-42e1-a2fb-a5f245cb19fb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:52.678070 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-aee4c385-5dda-42e1-a2fb-a5f245cb19fb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:52.684939 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aee4c385-5dda-42e1-a2fb-a5f245cb19fb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:52.685400 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aee4c385-5dda-42e1-a2fb-a5f245cb19fb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:52.686181 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aee4c385-5dda-42e1-a2fb-a5f245cb19fb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:52.686621 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aee4c385-5dda-42e1-a2fb-a5f245cb19fb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:52.894330 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-aee4c385-5dda-42e1-a2fb-a5f245cb19fb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:52.908075 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-aee4c385-5dda-42e1-a2fb-a5f245cb19fb tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1555 microversion: 2.1 time: 0.235629 Jul 12 18:30:52.908757 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 337/631] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:52 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1555 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:53.065630 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-44ab69d2-315a-4bdf-b535-45f8f1548004 req-449d7b21-a24d-4027-877c-20f2aa3d2cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c546fb53-6e12-426c-99a6-e6264514203d", "name": "network-vif-deleted", "tag": "6becd9b8-f6f0-4c1e-8ce2-67eb379069f7"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:30:53.074623 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-44ab69d2-315a-4bdf-b535-45f8f1548004 req-449d7b21-a24d-4027-877c-20f2aa3d2cbb service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:53.075051 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-44ab69d2-315a-4bdf-b535-45f8f1548004 req-449d7b21-a24d-4027-877c-20f2aa3d2cbb service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:53.086629 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-44ab69d2-315a-4bdf-b535-45f8f1548004 req-449d7b21-a24d-4027-877c-20f2aa3d2cbb service nova] Creating event network-vif-deleted:6becd9b8-f6f0-4c1e-8ce2-67eb379069f7 for instance c546fb53-6e12-426c-99a6-e6264514203d on hv-cinder-84488 Jul 12 18:30:53.091620 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-44ab69d2-315a-4bdf-b535-45f8f1548004 req-449d7b21-a24d-4027-877c-20f2aa3d2cbb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164753 Jul 12 18:30:53.092220 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 295/632] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:30:53.927794 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b095da19-03ba-4a31-b13e-5a5b156bd932 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:53.928445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b095da19-03ba-4a31-b13e-5a5b156bd932 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:53.934755 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b095da19-03ba-4a31-b13e-5a5b156bd932 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:53.935206 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b095da19-03ba-4a31-b13e-5a5b156bd932 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:53.935969 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b095da19-03ba-4a31-b13e-5a5b156bd932 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:53.936425 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b095da19-03ba-4a31-b13e-5a5b156bd932 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:53.967794 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b095da19-03ba-4a31-b13e-5a5b156bd932 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:53.968277 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b095da19-03ba-4a31-b13e-5a5b156bd932 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:53.968712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-b095da19-03ba-4a31-b13e-5a5b156bd932 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lazy-loading 'fault' on Instance uuid c546fb53-6e12-426c-99a6-e6264514203d {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:30:54.011668 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b095da19-03ba-4a31-b13e-5a5b156bd932 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36c7fd357044ccbb59bddd12b61149', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9b591880e9441acac9ddf006a5f9959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:30:54.019385 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b095da19-03ba-4a31-b13e-5a5b156bd932 tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 200 len: 1348 microversion: 2.1 time: 0.096082 Jul 12 18:30:54.019975 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 338/633] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:53 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:30:55.041624 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a9228701-12c6-454b-af11-eeb82275ba7d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:55.042346 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a9228701-12c6-454b-af11-eeb82275ba7d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] [instance: c546fb53-6e12-426c-99a6-e6264514203d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:55.048534 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9228701-12c6-454b-af11-eeb82275ba7d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:55.048972 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9228701-12c6-454b-af11-eeb82275ba7d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:55.049724 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9228701-12c6-454b-af11-eeb82275ba7d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:55.050148 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9228701-12c6-454b-af11-eeb82275ba7d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:55.063966 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-a9228701-12c6-454b-af11-eeb82275ba7d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] HTTP exception thrown: Instance c546fb53-6e12-426c-99a6-e6264514203d could not be found. Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a9228701-12c6-454b-af11-eeb82275ba7d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Request method failure captured: Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d HTTP/1.1 Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb0Z2UQRA-D2Xs2cz0ajRAAnmaLs3A1T7_Z-rVi42lzUPeX8NgJjpikqa-xDymrtqxfbJCi9JtxNK_bAkSbNAcAskyjKbgdnDx-3LlrwBqjbLuwXgfRPZRyToGpfKd-f7T3ae9kxg34QipORqadX2jnwUjeOPj2BQb3MGj7fuuy5rmk Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: c9b591880e9441acac9ddf006a5f9959 Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-TestMinimumBasicScenario-1417366020 Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:30:55.065589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c9b591880e9441acac9ddf006a5f9959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c9b591880e9441acac9ddf006a5f9959"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c9b591880e9441acac9ddf006a5f9959", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c9b591880e9441acac9ddf006a5f9959"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-TestMinimumBasicScenario-1417366020 Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: c9b591880e9441acac9ddf006a5f9959 Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1417366020 Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-TestMinimumBasicScenario-1417366020-project Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 0e36c7fd357044ccbb59bddd12b61149 Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-TestMinimumBasicScenario-1417366020-project Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance c546fb53-6e12-426c-99a6-e6264514203d could not be found. Jul 12 18:30:55.070886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'c546fb53-6e12-426c-99a6-e6264514203d'} Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c546fb53-6e12-426c-99a6-e6264514203d could not be found. Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:30:55.071645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c546fb53-6e12-426c-99a6-e6264514203d could not be found. Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c546fb53-6e12-426c-99a6-e6264514203d could not be found. Jul 12 18:30:55.073066 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:30:55.074311 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a9228701-12c6-454b-af11-eeb82275ba7d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Returning 404 to user: Instance c546fb53-6e12-426c-99a6-e6264514203d could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:30:55.074311 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a9228701-12c6-454b-af11-eeb82275ba7d tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d" status: 404 len: 111 microversion: 2.1 time: 0.030118 Jul 12 18:30:55.074311 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 296/634] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:30:55 2022] GET /compute/v2.1/servers/c546fb53-6e12-426c-99a6-e6264514203d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 18:30:55.076612 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6c75b9fc-5a3d-4810-a1af-9a8f5cbe935a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] Calling method '.version_select at 0x7f1bb0aabdc0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:55.180924 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6c75b9fc-5a3d-4810-a1af-9a8f5cbe935a tempest-TestMinimumBasicScenario-1417366020 tempest-TestMinimumBasicScenario-1417366020-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-841300904" status: 202 len: 0 microversion: 2.1 time: 0.108096 Jul 12 18:30:55.181508 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 339/635] 10.222.0.47 () {58 vars in 1268 bytes} [Tue Jul 12 18:30:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-841300904 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:30:59.593046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-27965821-cf76-4584-9765-31fff4086897 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:30:59.594467 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-27965821-cf76-4584-9765-31fff4086897 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:30:59.604165 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27965821-cf76-4584-9765-31fff4086897 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:59.604869 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27965821-cf76-4584-9765-31fff4086897 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:59.605914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27965821-cf76-4584-9765-31fff4086897 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:30:59.606521 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27965821-cf76-4584-9765-31fff4086897 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:30:59.639454 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-27965821-cf76-4584-9765-31fff4086897 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/ips" status: 200 len: 153 microversion: 2.20 time: 0.295888 Jul 12 18:30:59.640147 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 297/636] 10.222.0.47 () {60 vars in 1288 bytes} [Tue Jul 12 18:30:59 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/ips => generated 153 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:31:01.970046 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1bd97fa3-d424-488c-827f-4d8d4f96ca3f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:31:01.970960 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1bd97fa3-d424-488c-827f-4d8d4f96ca3f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:01.978259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bd97fa3-d424-488c-827f-4d8d4f96ca3f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:01.978827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bd97fa3-d424-488c-827f-4d8d4f96ca3f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:01.979476 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bd97fa3-d424-488c-827f-4d8d4f96ca3f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:01.979940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bd97fa3-d424-488c-827f-4d8d4f96ca3f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:02.010022 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-1bd97fa3-d424-488c-827f-4d8d4f96ca3f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lazy-loading 'flavor' on Instance uuid f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:31:02.610141 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1bd97fa3-d424-488c-827f-4d8d4f96ca3f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "POST /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/action" status: 202 len: 0 microversion: 2.20 time: 0.644998 Jul 12 18:31:02.610986 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 340/637] 10.222.0.47 () {62 vars in 1318 bytes} [Tue Jul 12 18:31:01 2022] POST /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:31:02.625703 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9e4c60f9-6765-47c2-92b6-3a64f426710c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:02.626814 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9e4c60f9-6765-47c2-92b6-3a64f426710c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:02.631094 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:02.639229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e4c60f9-6765-47c2-92b6-3a64f426710c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:02.639915 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e4c60f9-6765-47c2-92b6-3a64f426710c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:02.641293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e4c60f9-6765-47c2-92b6-3a64f426710c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:02.642023 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e4c60f9-6765-47c2-92b6-3a64f426710c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:03.188756 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9e4c60f9-6765-47c2-92b6-3a64f426710c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:03.206226 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9e4c60f9-6765-47c2-92b6-3a64f426710c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:03.211794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9e4c60f9-6765-47c2-92b6-3a64f426710c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:03.214389 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9e4c60f9-6765-47c2-92b6-3a64f426710c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1722 microversion: 2.20 time: 0.595389 Jul 12 18:31:03.215587 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 298/638] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:02 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1722 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:04.244056 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8194272e-d1c2-4cda-b42c-197ec9243591 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:04.244955 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8194272e-d1c2-4cda-b42c-197ec9243591 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:04.256342 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8194272e-d1c2-4cda-b42c-197ec9243591 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:04.256906 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8194272e-d1c2-4cda-b42c-197ec9243591 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:04.257809 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8194272e-d1c2-4cda-b42c-197ec9243591 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:04.258460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8194272e-d1c2-4cda-b42c-197ec9243591 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:04.468168 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8194272e-d1c2-4cda-b42c-197ec9243591 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:04.477438 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8194272e-d1c2-4cda-b42c-197ec9243591 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:04.479020 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8194272e-d1c2-4cda-b42c-197ec9243591 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:04.480187 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8194272e-d1c2-4cda-b42c-197ec9243591 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1722 microversion: 2.20 time: 0.242165 Jul 12 18:31:04.480835 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 341/639] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:04 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:05.501127 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2ac78a43-08a4-4279-96ae-fe76eca63900 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:05.501668 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2ac78a43-08a4-4279-96ae-fe76eca63900 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:05.509318 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ac78a43-08a4-4279-96ae-fe76eca63900 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:05.509760 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ac78a43-08a4-4279-96ae-fe76eca63900 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:05.510660 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ac78a43-08a4-4279-96ae-fe76eca63900 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:05.511363 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ac78a43-08a4-4279-96ae-fe76eca63900 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:05.779899 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2ac78a43-08a4-4279-96ae-fe76eca63900 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:05.802186 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2ac78a43-08a4-4279-96ae-fe76eca63900 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:05.804292 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2ac78a43-08a4-4279-96ae-fe76eca63900 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:05.805563 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2ac78a43-08a4-4279-96ae-fe76eca63900 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1722 microversion: 2.20 time: 0.308515 Jul 12 18:31:05.806385 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 299/640] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:05 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:06.829484 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ed2ff3ef-32f6-4366-8072-8017f7a8c8eb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:06.830528 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ed2ff3ef-32f6-4366-8072-8017f7a8c8eb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:06.857190 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ed2ff3ef-32f6-4366-8072-8017f7a8c8eb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:06.861443 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ed2ff3ef-32f6-4366-8072-8017f7a8c8eb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:06.861443 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ed2ff3ef-32f6-4366-8072-8017f7a8c8eb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:06.861443 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ed2ff3ef-32f6-4366-8072-8017f7a8c8eb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:07.018535 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ed2ff3ef-32f6-4366-8072-8017f7a8c8eb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:07.027048 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ed2ff3ef-32f6-4366-8072-8017f7a8c8eb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:07.028612 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ed2ff3ef-32f6-4366-8072-8017f7a8c8eb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:07.029778 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ed2ff3ef-32f6-4366-8072-8017f7a8c8eb tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1722 microversion: 2.20 time: 0.207847 Jul 12 18:31:07.030340 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 342/641] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:06 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:08.050690 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a0070687-9008-478b-a981-db618a857066 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:08.051958 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a0070687-9008-478b-a981-db618a857066 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:08.059408 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a0070687-9008-478b-a981-db618a857066 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:08.059966 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a0070687-9008-478b-a981-db618a857066 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:08.060880 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a0070687-9008-478b-a981-db618a857066 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:08.061407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a0070687-9008-478b-a981-db618a857066 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:08.195564 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a0070687-9008-478b-a981-db618a857066 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:08.203613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a0070687-9008-478b-a981-db618a857066 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:08.205134 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a0070687-9008-478b-a981-db618a857066 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:08.206282 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a0070687-9008-478b-a981-db618a857066 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1722 microversion: 2.20 time: 0.160645 Jul 12 18:31:08.206903 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 300/642] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:08 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:09.094097 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cfb85aeb-04c3-41d9-90fc-e69bcc722303 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:09.094940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-cfb85aeb-04c3-41d9-90fc-e69bcc722303 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:09.101830 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cfb85aeb-04c3-41d9-90fc-e69bcc722303 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:09.102273 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cfb85aeb-04c3-41d9-90fc-e69bcc722303 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:09.103032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cfb85aeb-04c3-41d9-90fc-e69bcc722303 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:09.103460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cfb85aeb-04c3-41d9-90fc-e69bcc722303 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:09.126776 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-cfb85aeb-04c3-41d9-90fc-e69bcc722303 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/ips" status: 200 len: 144 microversion: 2.1 time: 0.037634 Jul 12 18:31:09.127350 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 343/643] 10.222.0.47 () {58 vars in 1247 bytes} [Tue Jul 12 18:31:09 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:31:09.226485 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a1d80010-6cdb-4178-ac34-b99172ed25e0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:09.227099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a1d80010-6cdb-4178-ac34-b99172ed25e0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:09.233779 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1d80010-6cdb-4178-ac34-b99172ed25e0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:09.234228 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1d80010-6cdb-4178-ac34-b99172ed25e0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:09.234997 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1d80010-6cdb-4178-ac34-b99172ed25e0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:09.235558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a1d80010-6cdb-4178-ac34-b99172ed25e0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:09.383370 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a1d80010-6cdb-4178-ac34-b99172ed25e0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:09.392267 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a1d80010-6cdb-4178-ac34-b99172ed25e0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:09.393810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a1d80010-6cdb-4178-ac34-b99172ed25e0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:09.395455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a1d80010-6cdb-4178-ac34-b99172ed25e0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1722 microversion: 2.20 time: 0.173038 Jul 12 18:31:09.396103 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 301/644] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:09 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:10.414888 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3935b3a6-9f24-446a-8a94-0f8a5bf5eb67 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:10.415488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3935b3a6-9f24-446a-8a94-0f8a5bf5eb67 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:10.421576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3935b3a6-9f24-446a-8a94-0f8a5bf5eb67 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:10.422023 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3935b3a6-9f24-446a-8a94-0f8a5bf5eb67 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:10.422766 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3935b3a6-9f24-446a-8a94-0f8a5bf5eb67 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:10.423192 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3935b3a6-9f24-446a-8a94-0f8a5bf5eb67 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:10.563510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3935b3a6-9f24-446a-8a94-0f8a5bf5eb67 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:10.578600 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3935b3a6-9f24-446a-8a94-0f8a5bf5eb67 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:10.580650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3935b3a6-9f24-446a-8a94-0f8a5bf5eb67 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:10.582131 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3935b3a6-9f24-446a-8a94-0f8a5bf5eb67 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1722 microversion: 2.20 time: 0.171842 Jul 12 18:31:10.583004 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 344/645] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:10 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:10.823943 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0c2a18e9-3450-4db7-9d71-526253853a57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb5bb02a-e052-445b-b5e0-79432c07efbb"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:31:10.825027 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0c2a18e9-3450-4db7-9d71-526253853a57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:10.831872 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c2a18e9-3450-4db7-9d71-526253853a57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:10.832975 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c2a18e9-3450-4db7-9d71-526253853a57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:10.833719 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c2a18e9-3450-4db7-9d71-526253853a57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:10.834142 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c2a18e9-3450-4db7-9d71-526253853a57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:11.603003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-197833a0-2c99-4425-bd50-2f334bd1d642 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:11.603784 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-197833a0-2c99-4425-bd50-2f334bd1d642 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:11.610615 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-197833a0-2c99-4425-bd50-2f334bd1d642 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:11.611099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-197833a0-2c99-4425-bd50-2f334bd1d642 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:11.611885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-197833a0-2c99-4425-bd50-2f334bd1d642 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:11.612448 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-197833a0-2c99-4425-bd50-2f334bd1d642 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:11.748799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-197833a0-2c99-4425-bd50-2f334bd1d642 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:11.749049 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0c2a18e9-3450-4db7-9d71-526253853a57 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "POST /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.929124 Jul 12 18:31:11.749663 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 302/646] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:31:10 2022] POST /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments => generated 194 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:31:11.758314 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-197833a0-2c99-4425-bd50-2f334bd1d642 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:11.759913 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-197833a0-2c99-4425-bd50-2f334bd1d642 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:11.761239 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-197833a0-2c99-4425-bd50-2f334bd1d642 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1722 microversion: 2.20 time: 0.162192 Jul 12 18:31:11.761804 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 345/647] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:11 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:31:12.781017 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-65534c6f-58b7-42e9-81db-5f022579aa60 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:12.781698 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-65534c6f-58b7-42e9-81db-5f022579aa60 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:12.788522 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65534c6f-58b7-42e9-81db-5f022579aa60 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:12.788966 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65534c6f-58b7-42e9-81db-5f022579aa60 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:12.789725 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65534c6f-58b7-42e9-81db-5f022579aa60 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:12.790144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65534c6f-58b7-42e9-81db-5f022579aa60 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:12.924051 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-65534c6f-58b7-42e9-81db-5f022579aa60 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:12.933807 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-65534c6f-58b7-42e9-81db-5f022579aa60 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:12.935296 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-65534c6f-58b7-42e9-81db-5f022579aa60 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:12.936506 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-65534c6f-58b7-42e9-81db-5f022579aa60 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1722 microversion: 2.20 time: 0.159928 Jul 12 18:31:12.937125 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 303/648] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:12 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:13.955099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d4981784-e544-4211-825a-87777f1d372f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:13.955690 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d4981784-e544-4211-825a-87777f1d372f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:13.962658 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d4981784-e544-4211-825a-87777f1d372f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:13.963113 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d4981784-e544-4211-825a-87777f1d372f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:13.963881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d4981784-e544-4211-825a-87777f1d372f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:13.964334 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d4981784-e544-4211-825a-87777f1d372f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:14.101032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d4981784-e544-4211-825a-87777f1d372f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:14.108138 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d4981784-e544-4211-825a-87777f1d372f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:14.109722 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d4981784-e544-4211-825a-87777f1d372f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:14.110869 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d4981784-e544-4211-825a-87777f1d372f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1743 microversion: 2.20 time: 0.159851 Jul 12 18:31:14.111587 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 346/649] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:13 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:15.130480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ac5a76c5-9c8b-4fa6-98a8-7be29c3b4245 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:15.131031 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ac5a76c5-9c8b-4fa6-98a8-7be29c3b4245 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:15.137605 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac5a76c5-9c8b-4fa6-98a8-7be29c3b4245 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:15.138045 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac5a76c5-9c8b-4fa6-98a8-7be29c3b4245 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:15.138797 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac5a76c5-9c8b-4fa6-98a8-7be29c3b4245 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:15.139220 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac5a76c5-9c8b-4fa6-98a8-7be29c3b4245 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:15.270076 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ac5a76c5-9c8b-4fa6-98a8-7be29c3b4245 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:15.278793 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ac5a76c5-9c8b-4fa6-98a8-7be29c3b4245 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:15.280357 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ac5a76c5-9c8b-4fa6-98a8-7be29c3b4245 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:15.281521 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ac5a76c5-9c8b-4fa6-98a8-7be29c3b4245 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1743 microversion: 2.20 time: 0.155288 Jul 12 18:31:15.282283 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 304/650] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:15 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:16.227176 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-5b6fd3dc-e208-48cd-a36c-b0312acd20f0 req-1f0a29e7-7128-4fc7-aa94-39b8b1986690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a", "name": "network-vif-plugged", "status": "completed", "tag": "f5d11a8c-c702-4fa1-8cbd-ab67a930e714"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:31:16.246377 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-5b6fd3dc-e208-48cd-a36c-b0312acd20f0 req-1f0a29e7-7128-4fc7-aa94-39b8b1986690 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:16.250353 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-5b6fd3dc-e208-48cd-a36c-b0312acd20f0 req-1f0a29e7-7128-4fc7-aa94-39b8b1986690 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:16.269385 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-5b6fd3dc-e208-48cd-a36c-b0312acd20f0 req-1f0a29e7-7128-4fc7-aa94-39b8b1986690 service nova] Creating event network-vif-plugged:f5d11a8c-c702-4fa1-8cbd-ab67a930e714 for instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a on hv-cinder-84488 Jul 12 18:31:16.276028 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-5b6fd3dc-e208-48cd-a36c-b0312acd20f0 req-1f0a29e7-7128-4fc7-aa94-39b8b1986690 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193180 Jul 12 18:31:16.277171 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 347/651] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:31:16.302205 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-db94ac4e-66c9-4e16-930b-3b5b17ff86f0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:16.302205 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-db94ac4e-66c9-4e16-930b-3b5b17ff86f0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:16.315314 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db94ac4e-66c9-4e16-930b-3b5b17ff86f0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:16.315971 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db94ac4e-66c9-4e16-930b-3b5b17ff86f0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:16.317459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db94ac4e-66c9-4e16-930b-3b5b17ff86f0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:16.318048 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db94ac4e-66c9-4e16-930b-3b5b17ff86f0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:16.503338 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-db94ac4e-66c9-4e16-930b-3b5b17ff86f0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:16.515607 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-db94ac4e-66c9-4e16-930b-3b5b17ff86f0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:16.522532 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-db94ac4e-66c9-4e16-930b-3b5b17ff86f0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:16.522532 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-db94ac4e-66c9-4e16-930b-3b5b17ff86f0 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1738 microversion: 2.20 time: 0.221871 Jul 12 18:31:16.522532 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 305/652] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:16 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:31:17.540489 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-053f834f-2bae-4e9d-ae04-1e4486e7d38a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:17.541552 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-053f834f-2bae-4e9d-ae04-1e4486e7d38a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:17.543566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:17.558259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-053f834f-2bae-4e9d-ae04-1e4486e7d38a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:17.558818 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-053f834f-2bae-4e9d-ae04-1e4486e7d38a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:17.560002 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-053f834f-2bae-4e9d-ae04-1e4486e7d38a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:17.560645 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-053f834f-2bae-4e9d-ae04-1e4486e7d38a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:17.730345 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-053f834f-2bae-4e9d-ae04-1e4486e7d38a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:17.739991 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-053f834f-2bae-4e9d-ae04-1e4486e7d38a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:17.741583 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-053f834f-2bae-4e9d-ae04-1e4486e7d38a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:17.742755 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-053f834f-2bae-4e9d-ae04-1e4486e7d38a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1738 microversion: 2.20 time: 0.207323 Jul 12 18:31:17.743307 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 348/653] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:17 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:18.763315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fa30c2ad-2c3f-4e45-b2ab-753790047f12 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:18.764029 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fa30c2ad-2c3f-4e45-b2ab-753790047f12 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:18.772539 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa30c2ad-2c3f-4e45-b2ab-753790047f12 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:18.772658 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa30c2ad-2c3f-4e45-b2ab-753790047f12 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:18.773440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa30c2ad-2c3f-4e45-b2ab-753790047f12 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:18.773878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa30c2ad-2c3f-4e45-b2ab-753790047f12 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:18.933558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fa30c2ad-2c3f-4e45-b2ab-753790047f12 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:18.941838 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fa30c2ad-2c3f-4e45-b2ab-753790047f12 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:18.943526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fa30c2ad-2c3f-4e45-b2ab-753790047f12 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:18.945322 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fa30c2ad-2c3f-4e45-b2ab-753790047f12 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1738 microversion: 2.20 time: 0.186522 Jul 12 18:31:18.945890 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 306/654] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:18 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:19.966268 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cd2be7ff-f69f-44e7-aa4f-67a7035a875c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:19.967006 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-cd2be7ff-f69f-44e7-aa4f-67a7035a875c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:19.974132 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd2be7ff-f69f-44e7-aa4f-67a7035a875c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:19.974711 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd2be7ff-f69f-44e7-aa4f-67a7035a875c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:19.975642 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd2be7ff-f69f-44e7-aa4f-67a7035a875c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:19.976251 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd2be7ff-f69f-44e7-aa4f-67a7035a875c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:19.979298 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:20.146876 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-cd2be7ff-f69f-44e7-aa4f-67a7035a875c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:20.161654 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-cd2be7ff-f69f-44e7-aa4f-67a7035a875c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:20.163203 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-cd2be7ff-f69f-44e7-aa4f-67a7035a875c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:20.164687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-cd2be7ff-f69f-44e7-aa4f-67a7035a875c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1738 microversion: 2.20 time: 0.203445 Jul 12 18:31:20.176560 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 349/655] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:19 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:20.364669 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4fa196b5-669a-4d4e-b6e5-d47da83ba17a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:20.365594 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4fa196b5-669a-4d4e-b6e5-d47da83ba17a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:20.375357 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fa196b5-669a-4d4e-b6e5-d47da83ba17a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:20.379761 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fa196b5-669a-4d4e-b6e5-d47da83ba17a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:20.379761 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fa196b5-669a-4d4e-b6e5-d47da83ba17a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:20.379761 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fa196b5-669a-4d4e-b6e5-d47da83ba17a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:20.381687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:20.416919 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4fa196b5-669a-4d4e-b6e5-d47da83ba17a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056762 Jul 12 18:31:20.417774 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 307/656] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:31:20 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:31:20.428150 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-aede8ecb-7f73-4d21-9a9d-d1d31d2afa97 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:20.428660 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-aede8ecb-7f73-4d21-9a9d-d1d31d2afa97 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:20.435452 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aede8ecb-7f73-4d21-9a9d-d1d31d2afa97 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:20.443180 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aede8ecb-7f73-4d21-9a9d-d1d31d2afa97 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:20.443180 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aede8ecb-7f73-4d21-9a9d-d1d31d2afa97 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:20.443180 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-aede8ecb-7f73-4d21-9a9d-d1d31d2afa97 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:20.480087 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-aede8ecb-7f73-4d21-9a9d-d1d31d2afa97 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments/eb5bb02a-e052-445b-b5e0-79432c07efbb" status: 200 len: 194 microversion: 2.1 time: 0.056092 Jul 12 18:31:20.480890 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 350/657] 10.222.0.47 () {58 vars in 1412 bytes} [Tue Jul 12 18:31:20 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments/eb5bb02a-e052-445b-b5e0-79432c07efbb => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:31:21.182262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-498dbeed-8c71-46d6-a0cb-657d2d833d44 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:21.183009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-498dbeed-8c71-46d6-a0cb-657d2d833d44 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:21.193938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-498dbeed-8c71-46d6-a0cb-657d2d833d44 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:21.196552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-498dbeed-8c71-46d6-a0cb-657d2d833d44 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:21.197536 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-498dbeed-8c71-46d6-a0cb-657d2d833d44 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:21.202929 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-498dbeed-8c71-46d6-a0cb-657d2d833d44 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:21.412258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-498dbeed-8c71-46d6-a0cb-657d2d833d44 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:21.423676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-498dbeed-8c71-46d6-a0cb-657d2d833d44 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:21.425877 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-498dbeed-8c71-46d6-a0cb-657d2d833d44 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:21.427964 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-498dbeed-8c71-46d6-a0cb-657d2d833d44 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1738 microversion: 2.20 time: 0.249704 Jul 12 18:31:21.428862 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 308/658] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:21 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:22.226759 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e8c4c11f-3dfa-443d-8b13-d36c1c58e969 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87c757f6-05c3-4b84-aeee-b63fdd6b832e"}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:31:22.227872 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e8c4c11f-3dfa-443d-8b13-d36c1c58e969 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:22.234959 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e8c4c11f-3dfa-443d-8b13-d36c1c58e969 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:22.239712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e8c4c11f-3dfa-443d-8b13-d36c1c58e969 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:22.239712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e8c4c11f-3dfa-443d-8b13-d36c1c58e969 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:22.239966 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e8c4c11f-3dfa-443d-8b13-d36c1c58e969 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:22.448190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6d150b33-db25-4a53-8c64-e6f258e914b3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:22.448748 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6d150b33-db25-4a53-8c64-e6f258e914b3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:22.462151 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d150b33-db25-4a53-8c64-e6f258e914b3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:22.462622 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d150b33-db25-4a53-8c64-e6f258e914b3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:22.463387 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d150b33-db25-4a53-8c64-e6f258e914b3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:22.463826 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d150b33-db25-4a53-8c64-e6f258e914b3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:22.641230 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6d150b33-db25-4a53-8c64-e6f258e914b3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:22.654206 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6d150b33-db25-4a53-8c64-e6f258e914b3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:22.655998 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6d150b33-db25-4a53-8c64-e6f258e914b3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:22.657304 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6d150b33-db25-4a53-8c64-e6f258e914b3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1738 microversion: 2.20 time: 0.214653 Jul 12 18:31:22.658089 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 309/659] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:22 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:31:23.104837 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e8c4c11f-3dfa-443d-8b13-d36c1c58e969 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "POST /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.884293 Jul 12 18:31:23.106203 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 351/660] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:31:22 2022] POST /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments => generated 194 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:31:23.678745 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b3203d3a-cdd4-487a-8397-888d292b6ded tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:23.680418 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b3203d3a-cdd4-487a-8397-888d292b6ded tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:23.687291 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b3203d3a-cdd4-487a-8397-888d292b6ded tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:23.687963 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b3203d3a-cdd4-487a-8397-888d292b6ded tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:23.694642 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b3203d3a-cdd4-487a-8397-888d292b6ded tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:23.694642 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b3203d3a-cdd4-487a-8397-888d292b6ded tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:23.845640 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b3203d3a-cdd4-487a-8397-888d292b6ded tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:23.855018 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b3203d3a-cdd4-487a-8397-888d292b6ded tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:23.856582 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b3203d3a-cdd4-487a-8397-888d292b6ded tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:23.857818 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b3203d3a-cdd4-487a-8397-888d292b6ded tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1738 microversion: 2.20 time: 0.184674 Jul 12 18:31:23.858574 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 310/661] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:23 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:24.882078 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5e71bf78-e189-4641-b398-f99d85813e77 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:24.883004 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5e71bf78-e189-4641-b398-f99d85813e77 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:24.890022 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5e71bf78-e189-4641-b398-f99d85813e77 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:24.893867 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5e71bf78-e189-4641-b398-f99d85813e77 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:24.893867 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5e71bf78-e189-4641-b398-f99d85813e77 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:24.893867 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5e71bf78-e189-4641-b398-f99d85813e77 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:25.046694 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5e71bf78-e189-4641-b398-f99d85813e77 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:25.054434 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5e71bf78-e189-4641-b398-f99d85813e77 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:25.055917 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5e71bf78-e189-4641-b398-f99d85813e77 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:25.057096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5e71bf78-e189-4641-b398-f99d85813e77 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1738 microversion: 2.20 time: 0.180816 Jul 12 18:31:25.057648 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 352/662] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:24 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:26.075593 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8d46b8a2-548a-43fb-bd7e-542646f752aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:26.076191 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8d46b8a2-548a-43fb-bd7e-542646f752aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:26.083171 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d46b8a2-548a-43fb-bd7e-542646f752aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:26.085986 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d46b8a2-548a-43fb-bd7e-542646f752aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:26.085986 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d46b8a2-548a-43fb-bd7e-542646f752aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:26.085986 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d46b8a2-548a-43fb-bd7e-542646f752aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:26.225291 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8d46b8a2-548a-43fb-bd7e-542646f752aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:26.237478 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8d46b8a2-548a-43fb-bd7e-542646f752aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:26.239984 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8d46b8a2-548a-43fb-bd7e-542646f752aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:26.241278 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8d46b8a2-548a-43fb-bd7e-542646f752aa tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1738 microversion: 2.20 time: 0.169612 Jul 12 18:31:26.241860 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 311/663] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:26 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:27.260657 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-05b8afd6-c09d-4a4d-8d47-dc3406e282e9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:27.261339 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-05b8afd6-c09d-4a4d-8d47-dc3406e282e9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:27.268526 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05b8afd6-c09d-4a4d-8d47-dc3406e282e9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:27.269319 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05b8afd6-c09d-4a4d-8d47-dc3406e282e9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:27.270977 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05b8afd6-c09d-4a4d-8d47-dc3406e282e9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:27.271594 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05b8afd6-c09d-4a4d-8d47-dc3406e282e9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:27.408208 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-05b8afd6-c09d-4a4d-8d47-dc3406e282e9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:27.416293 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-05b8afd6-c09d-4a4d-8d47-dc3406e282e9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:27.417822 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-05b8afd6-c09d-4a4d-8d47-dc3406e282e9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:27.418986 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-05b8afd6-c09d-4a4d-8d47-dc3406e282e9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1738 microversion: 2.20 time: 0.162540 Jul 12 18:31:27.419543 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 353/664] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:27 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:28.438747 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-dfff7b5f-5d08-4274-a412-682dee707747 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:28.439918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-dfff7b5f-5d08-4274-a412-682dee707747 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:28.450972 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dfff7b5f-5d08-4274-a412-682dee707747 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:28.452126 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dfff7b5f-5d08-4274-a412-682dee707747 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:28.453953 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dfff7b5f-5d08-4274-a412-682dee707747 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:28.455761 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dfff7b5f-5d08-4274-a412-682dee707747 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:28.655103 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dfff7b5f-5d08-4274-a412-682dee707747 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:28.663976 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dfff7b5f-5d08-4274-a412-682dee707747 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:28.665531 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dfff7b5f-5d08-4274-a412-682dee707747 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:28.671323 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-dfff7b5f-5d08-4274-a412-682dee707747 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1720 microversion: 2.20 time: 0.232327 Jul 12 18:31:28.671323 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 312/665] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:28 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:31:29.685709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fcd5f334-0828-4e5b-8417-b445062663c1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:29.686320 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fcd5f334-0828-4e5b-8417-b445062663c1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:29.693049 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fcd5f334-0828-4e5b-8417-b445062663c1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:29.693498 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fcd5f334-0828-4e5b-8417-b445062663c1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:29.694270 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fcd5f334-0828-4e5b-8417-b445062663c1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:29.694705 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fcd5f334-0828-4e5b-8417-b445062663c1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:29.868728 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fcd5f334-0828-4e5b-8417-b445062663c1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:29.877878 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fcd5f334-0828-4e5b-8417-b445062663c1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:29.878386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fcd5f334-0828-4e5b-8417-b445062663c1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:29.879550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fcd5f334-0828-4e5b-8417-b445062663c1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1720 microversion: 2.20 time: 0.197862 Jul 12 18:31:29.880099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 354/666] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:29 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:30.137318 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-8b406906-0e55-4437-bb52-adb18ff93c5a req-77b8511f-e7b1-4cb0-b7d3-df399acfb93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a", "name": "network-vif-unplugged", "status": "completed", "tag": "f5d11a8c-c702-4fa1-8cbd-ab67a930e714"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:31:30.146112 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-8b406906-0e55-4437-bb52-adb18ff93c5a req-77b8511f-e7b1-4cb0-b7d3-df399acfb93b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:30.148114 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-8b406906-0e55-4437-bb52-adb18ff93c5a req-77b8511f-e7b1-4cb0-b7d3-df399acfb93b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:30.157772 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-8b406906-0e55-4437-bb52-adb18ff93c5a req-77b8511f-e7b1-4cb0-b7d3-df399acfb93b service nova] Creating event network-vif-unplugged:f5d11a8c-c702-4fa1-8cbd-ab67a930e714 for instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a on hv-cinder-84488 Jul 12 18:31:30.163481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-8b406906-0e55-4437-bb52-adb18ff93c5a req-77b8511f-e7b1-4cb0-b7d3-df399acfb93b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030653 Jul 12 18:31:30.164154 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 313/667] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:31:30.899700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-47b3a967-8679-49da-ad87-6d63861a8d6c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:30.900296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-47b3a967-8679-49da-ad87-6d63861a8d6c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:30.907377 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-47b3a967-8679-49da-ad87-6d63861a8d6c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:30.908047 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-47b3a967-8679-49da-ad87-6d63861a8d6c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:30.909456 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-47b3a967-8679-49da-ad87-6d63861a8d6c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:30.910448 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-47b3a967-8679-49da-ad87-6d63861a8d6c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:31.094525 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-47b3a967-8679-49da-ad87-6d63861a8d6c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:31.106952 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-47b3a967-8679-49da-ad87-6d63861a8d6c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:31.112619 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-47b3a967-8679-49da-ad87-6d63861a8d6c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:31.112619 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-47b3a967-8679-49da-ad87-6d63861a8d6c tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1723 microversion: 2.20 time: 0.216392 Jul 12 18:31:31.112619 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 355/668] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:30 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:31.132767 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9b4af6ef-a8c8-4096-9f11-0421f20a322d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08a9fb9c-fd76-4b98-97ac-e51c4ce30b3d"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:31:31.133943 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9b4af6ef-a8c8-4096-9f11-0421f20a322d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:31.141754 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b4af6ef-a8c8-4096-9f11-0421f20a322d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:31.142500 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b4af6ef-a8c8-4096-9f11-0421f20a322d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:31.143028 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b4af6ef-a8c8-4096-9f11-0421f20a322d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:31.143457 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b4af6ef-a8c8-4096-9f11-0421f20a322d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:31.866970 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d114d4c3-fa19-4a1f-9a21-98a4c1faa5e0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:31.867972 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d114d4c3-fa19-4a1f-9a21-98a4c1faa5e0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:31.874139 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d114d4c3-fa19-4a1f-9a21-98a4c1faa5e0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:31.878617 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d114d4c3-fa19-4a1f-9a21-98a4c1faa5e0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:31.878617 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d114d4c3-fa19-4a1f-9a21-98a4c1faa5e0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:31.878617 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d114d4c3-fa19-4a1f-9a21-98a4c1faa5e0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:31.908096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d114d4c3-fa19-4a1f-9a21-98a4c1faa5e0 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045235 Jul 12 18:31:31.908818 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 356/669] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:31:31 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:31:32.058673 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2f4cffb6-0e07-4162-9148-a1e642995bea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:32.059167 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2f4cffb6-0e07-4162-9148-a1e642995bea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:32.066729 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2f4cffb6-0e07-4162-9148-a1e642995bea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:32.075296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2f4cffb6-0e07-4162-9148-a1e642995bea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:32.075296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2f4cffb6-0e07-4162-9148-a1e642995bea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:32.075296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2f4cffb6-0e07-4162-9148-a1e642995bea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:32.101358 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2f4cffb6-0e07-4162-9148-a1e642995bea tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments/eb5bb02a-e052-445b-b5e0-79432c07efbb" status: 200 len: 194 microversion: 2.1 time: 0.046588 Jul 12 18:31:32.101977 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 357/670] 10.222.0.47 () {58 vars in 1412 bytes} [Tue Jul 12 18:31:32 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments/eb5bb02a-e052-445b-b5e0-79432c07efbb => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:31:32.111514 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a58869ea-b15f-4175-91b1-0af7943bcac7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:32.112006 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a58869ea-b15f-4175-91b1-0af7943bcac7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:32.118653 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a58869ea-b15f-4175-91b1-0af7943bcac7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:32.119105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a58869ea-b15f-4175-91b1-0af7943bcac7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:32.119873 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a58869ea-b15f-4175-91b1-0af7943bcac7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:32.120301 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a58869ea-b15f-4175-91b1-0af7943bcac7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:32.343788 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-a58869ea-b15f-4175-91b1-0af7943bcac7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lazy-loading 'services' on Instance uuid 7457d661-1f52-4e7d-b723-1f18292c5b9a {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:31:32.401465 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9b4af6ef-a8c8-4096-9f11-0421f20a322d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "POST /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.274086 Jul 12 18:31:32.402103 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 314/671] 10.222.0.47 () {62 vars in 1363 bytes} [Tue Jul 12 18:31:31 2022] POST /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/os-volume_attachments => generated 188 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:31:32.577518 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-970936b5-57f7-4042-9b6f-1f296379e2d5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:32.578109 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-970936b5-57f7-4042-9b6f-1f296379e2d5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:32.585969 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-970936b5-57f7-4042-9b6f-1f296379e2d5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:32.586411 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-970936b5-57f7-4042-9b6f-1f296379e2d5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:32.587183 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-970936b5-57f7-4042-9b6f-1f296379e2d5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:32.587600 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-970936b5-57f7-4042-9b6f-1f296379e2d5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:32.630965 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a58869ea-b15f-4175-91b1-0af7943bcac7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments/eb5bb02a-e052-445b-b5e0-79432c07efbb" status: 202 len: 0 microversion: 2.1 time: 0.523117 Jul 12 18:31:32.631576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 358/672] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:31:32 2022] DELETE /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments/eb5bb02a-e052-445b-b5e0-79432c07efbb => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:31:33.288006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-970936b5-57f7-4042-9b6f-1f296379e2d5 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/os-volume_attachments/08a9fb9c-fd76-4b98-97ac-e51c4ce30b3d" status: 202 len: 0 microversion: 2.20 time: 0.714448 Jul 12 18:31:33.288664 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 315/673] 10.222.0.47 () {60 vars in 1456 bytes} [Tue Jul 12 18:31:32 2022] DELETE /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/os-volume_attachments/08a9fb9c-fd76-4b98-97ac-e51c4ce30b3d => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 18:31:33.352874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-223c259e-28aa-4dfa-9517-283f35ddd24d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:31:33.353540 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-223c259e-28aa-4dfa-9517-283f35ddd24d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:33.360898 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-223c259e-28aa-4dfa-9517-283f35ddd24d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:33.361309 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-223c259e-28aa-4dfa-9517-283f35ddd24d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:33.362090 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-223c259e-28aa-4dfa-9517-283f35ddd24d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:33.362517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-223c259e-28aa-4dfa-9517-283f35ddd24d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:33.722576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-223c259e-28aa-4dfa-9517-283f35ddd24d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "POST /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/action" status: 202 len: 0 microversion: 2.20 time: 0.376074 Jul 12 18:31:33.723249 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 359/674] 10.222.0.47 () {62 vars in 1318 bytes} [Tue Jul 12 18:31:33 2022] POST /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:31:33.732046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-33263f78-94d2-4e97-81d1-62936622f0e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:33.732694 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-33263f78-94d2-4e97-81d1-62936622f0e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:33.740451 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=36 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:33.742541 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33263f78-94d2-4e97-81d1-62936622f0e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:33.742913 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33263f78-94d2-4e97-81d1-62936622f0e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:33.744001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33263f78-94d2-4e97-81d1-62936622f0e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:33.744622 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33263f78-94d2-4e97-81d1-62936622f0e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:33.890246 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-33263f78-94d2-4e97-81d1-62936622f0e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:33.900044 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-33263f78-94d2-4e97-81d1-62936622f0e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:33.901604 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-33263f78-94d2-4e97-81d1-62936622f0e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:33.902753 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-33263f78-94d2-4e97-81d1-62936622f0e4 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1671 microversion: 2.20 time: 0.174762 Jul 12 18:31:33.903662 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 316/675] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:33 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:34.829943 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0ef7d69f-e95f-404e-9a03-30a57e0825a9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:34.830421 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0ef7d69f-e95f-404e-9a03-30a57e0825a9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:34.837719 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ef7d69f-e95f-404e-9a03-30a57e0825a9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:34.838161 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ef7d69f-e95f-404e-9a03-30a57e0825a9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:34.838926 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ef7d69f-e95f-404e-9a03-30a57e0825a9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:34.839356 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ef7d69f-e95f-404e-9a03-30a57e0825a9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:34.871613 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0ef7d69f-e95f-404e-9a03-30a57e0825a9 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments/87c757f6-05c3-4b84-aeee-b63fdd6b832e" status: 200 len: 194 microversion: 2.1 time: 0.045949 Jul 12 18:31:34.872204 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 360/676] 10.222.0.47 () {58 vars in 1412 bytes} [Tue Jul 12 18:31:34 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments/87c757f6-05c3-4b84-aeee-b63fdd6b832e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:31:34.882886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-94f6a053-2238-4e1f-853b-8f13a2d72103 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:34.883378 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-94f6a053-2238-4e1f-853b-8f13a2d72103 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:34.890545 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-94f6a053-2238-4e1f-853b-8f13a2d72103 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:34.899903 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-94f6a053-2238-4e1f-853b-8f13a2d72103 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:34.899903 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-94f6a053-2238-4e1f-853b-8f13a2d72103 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:34.899903 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-94f6a053-2238-4e1f-853b-8f13a2d72103 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:34.928483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-04c35a90-9757-43c3-884d-a27be7f3cdd9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:34.928483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-04c35a90-9757-43c3-884d-a27be7f3cdd9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:34.932301 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-04c35a90-9757-43c3-884d-a27be7f3cdd9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:34.932765 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-04c35a90-9757-43c3-884d-a27be7f3cdd9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:34.934065 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-04c35a90-9757-43c3-884d-a27be7f3cdd9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:34.934565 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-04c35a90-9757-43c3-884d-a27be7f3cdd9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:34.983469 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-94f6a053-2238-4e1f-853b-8f13a2d72103 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lazy-loading 'services' on Instance uuid 7457d661-1f52-4e7d-b723-1f18292c5b9a {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:31:35.086091 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-04c35a90-9757-43c3-884d-a27be7f3cdd9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:35.094717 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-04c35a90-9757-43c3-884d-a27be7f3cdd9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:35.096211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-04c35a90-9757-43c3-884d-a27be7f3cdd9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:35.097436 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-04c35a90-9757-43c3-884d-a27be7f3cdd9 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1671 microversion: 2.20 time: 0.176841 Jul 12 18:31:35.098072 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 361/677] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:34 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:35.247627 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-94f6a053-2238-4e1f-853b-8f13a2d72103 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments/87c757f6-05c3-4b84-aeee-b63fdd6b832e" status: 202 len: 0 microversion: 2.1 time: 0.368588 Jul 12 18:31:35.248155 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 317/678] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:31:34 2022] DELETE /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments/87c757f6-05c3-4b84-aeee-b63fdd6b832e => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:31:36.118149 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-44c674b7-0d4c-47cd-a1ef-017306b4c275 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:36.118832 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-44c674b7-0d4c-47cd-a1ef-017306b4c275 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:36.125698 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-44c674b7-0d4c-47cd-a1ef-017306b4c275 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:36.126172 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-44c674b7-0d4c-47cd-a1ef-017306b4c275 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:36.126948 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-44c674b7-0d4c-47cd-a1ef-017306b4c275 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:36.127380 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-44c674b7-0d4c-47cd-a1ef-017306b4c275 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:36.269021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-44c674b7-0d4c-47cd-a1ef-017306b4c275 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:36.276550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:36.279776 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-44c674b7-0d4c-47cd-a1ef-017306b4c275 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:36.281300 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-44c674b7-0d4c-47cd-a1ef-017306b4c275 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:36.282467 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-44c674b7-0d4c-47cd-a1ef-017306b4c275 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.169448 Jul 12 18:31:36.283080 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 362/679] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:36 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:37.304912 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ab0d1ff4-6a56-4c86-aefa-13153758456d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:37.305762 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ab0d1ff4-6a56-4c86-aefa-13153758456d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:37.313026 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ab0d1ff4-6a56-4c86-aefa-13153758456d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:37.313473 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ab0d1ff4-6a56-4c86-aefa-13153758456d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:37.314796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ab0d1ff4-6a56-4c86-aefa-13153758456d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:37.314796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ab0d1ff4-6a56-4c86-aefa-13153758456d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:37.337538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=6,nova_cell1:UPDATE=8 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:37.469304 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ab0d1ff4-6a56-4c86-aefa-13153758456d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:37.479808 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ab0d1ff4-6a56-4c86-aefa-13153758456d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:37.481344 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ab0d1ff4-6a56-4c86-aefa-13153758456d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:37.482489 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ab0d1ff4-6a56-4c86-aefa-13153758456d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.183705 Jul 12 18:31:37.483053 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 318/680] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:37 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:37.505075 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-29970ff4-0fd9-460a-9d7a-9a8f0d2e97c5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:37.508846 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-29970ff4-0fd9-460a-9d7a-9a8f0d2e97c5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:37.516296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-29970ff4-0fd9-460a-9d7a-9a8f0d2e97c5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:37.516766 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-29970ff4-0fd9-460a-9d7a-9a8f0d2e97c5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:37.517530 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-29970ff4-0fd9-460a-9d7a-9a8f0d2e97c5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:37.517976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-29970ff4-0fd9-460a-9d7a-9a8f0d2e97c5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:37.550974 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-29970ff4-0fd9-460a-9d7a-9a8f0d2e97c5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049915 Jul 12 18:31:37.552127 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 363/681] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:31:37 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:31:37.672076 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-da9069cb-7d6d-4683-9fe8-5d8d3de17426 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:37.673439 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-da9069cb-7d6d-4683-9fe8-5d8d3de17426 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:37.683397 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da9069cb-7d6d-4683-9fe8-5d8d3de17426 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:37.683850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da9069cb-7d6d-4683-9fe8-5d8d3de17426 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:37.684650 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da9069cb-7d6d-4683-9fe8-5d8d3de17426 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:37.685081 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da9069cb-7d6d-4683-9fe8-5d8d3de17426 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:37.720504 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-da9069cb-7d6d-4683-9fe8-5d8d3de17426 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052521 Jul 12 18:31:37.720504 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 319/682] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:31:37 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:31:37.785182 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-09ef0444-34e5-463c-8bb8-9e8a784472ce tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:37.786207 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-09ef0444-34e5-463c-8bb8-9e8a784472ce tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:37.795143 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-09ef0444-34e5-463c-8bb8-9e8a784472ce tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:37.795143 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-09ef0444-34e5-463c-8bb8-9e8a784472ce tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:37.795143 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-09ef0444-34e5-463c-8bb8-9e8a784472ce tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:37.795528 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-09ef0444-34e5-463c-8bb8-9e8a784472ce tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:37.823060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-09ef0444-34e5-463c-8bb8-9e8a784472ce tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:31:38.316258 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-09ef0444-34e5-463c-8bb8-9e8a784472ce tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 204 len: 0 microversion: 2.1 time: 0.534712 Jul 12 18:31:38.317674 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 364/683] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:31:37 2022] DELETE /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:31:38.326080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e25e8f2b-813a-4ef8-b19c-90884dba11c3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:38.327550 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e25e8f2b-813a-4ef8-b19c-90884dba11c3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:38.334929 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e25e8f2b-813a-4ef8-b19c-90884dba11c3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:38.339188 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e25e8f2b-813a-4ef8-b19c-90884dba11c3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:38.339188 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e25e8f2b-813a-4ef8-b19c-90884dba11c3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:38.339188 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e25e8f2b-813a-4ef8-b19c-90884dba11c3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:38.487595 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e25e8f2b-813a-4ef8-b19c-90884dba11c3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:38.497643 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e25e8f2b-813a-4ef8-b19c-90884dba11c3 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1673 microversion: 2.1 time: 0.175292 Jul 12 18:31:38.503547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-78f2f139-20a3-4ced-847d-429173b9914f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:38.505240 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-78f2f139-20a3-4ced-847d-429173b9914f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:38.512407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 320/684] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:38 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:38.518172 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-78f2f139-20a3-4ced-847d-429173b9914f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:38.518731 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-78f2f139-20a3-4ced-847d-429173b9914f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:38.519583 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-78f2f139-20a3-4ced-847d-429173b9914f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:38.520848 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-78f2f139-20a3-4ced-847d-429173b9914f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:38.932984 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-78f2f139-20a3-4ced-847d-429173b9914f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:38.942411 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-78f2f139-20a3-4ced-847d-429173b9914f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:38.943939 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-78f2f139-20a3-4ced-847d-429173b9914f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:38.945424 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-78f2f139-20a3-4ced-847d-429173b9914f tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.447303 Jul 12 18:31:38.946546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 365/685] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:38 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:31:39.516132 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-08d75ca6-c697-4b69-aafc-0ebdc14feb46 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:39.516764 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-08d75ca6-c697-4b69-aafc-0ebdc14feb46 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:39.524440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-08d75ca6-c697-4b69-aafc-0ebdc14feb46 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:39.524882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-08d75ca6-c697-4b69-aafc-0ebdc14feb46 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:39.525841 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-08d75ca6-c697-4b69-aafc-0ebdc14feb46 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:39.526271 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-08d75ca6-c697-4b69-aafc-0ebdc14feb46 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:39.689456 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-08d75ca6-c697-4b69-aafc-0ebdc14feb46 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:39.699345 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-08d75ca6-c697-4b69-aafc-0ebdc14feb46 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1673 microversion: 2.1 time: 0.186856 Jul 12 18:31:39.700078 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 321/686] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:39 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1673 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:39.965843 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-31972015-d3b0-497f-8b6a-11dfd09ef575 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:39.967359 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-31972015-d3b0-497f-8b6a-11dfd09ef575 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:39.976021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-31972015-d3b0-497f-8b6a-11dfd09ef575 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:39.976679 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-31972015-d3b0-497f-8b6a-11dfd09ef575 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:39.977461 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-31972015-d3b0-497f-8b6a-11dfd09ef575 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:39.978156 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-31972015-d3b0-497f-8b6a-11dfd09ef575 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:40.127465 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-31972015-d3b0-497f-8b6a-11dfd09ef575 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:40.137172 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-31972015-d3b0-497f-8b6a-11dfd09ef575 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:40.139003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-31972015-d3b0-497f-8b6a-11dfd09ef575 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:40.140378 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-31972015-d3b0-497f-8b6a-11dfd09ef575 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.178838 Jul 12 18:31:40.149739 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 366/687] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:39 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:40.717819 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b56264ba-6c07-481a-8efd-727ba5be3f15 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:40.719182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b56264ba-6c07-481a-8efd-727ba5be3f15 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:40.728233 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b56264ba-6c07-481a-8efd-727ba5be3f15 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:40.729075 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b56264ba-6c07-481a-8efd-727ba5be3f15 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:40.729984 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b56264ba-6c07-481a-8efd-727ba5be3f15 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:40.730425 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b56264ba-6c07-481a-8efd-727ba5be3f15 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:40.907453 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b56264ba-6c07-481a-8efd-727ba5be3f15 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:40.919286 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b56264ba-6c07-481a-8efd-727ba5be3f15 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1673 microversion: 2.1 time: 0.205119 Jul 12 18:31:40.920219 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 322/688] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:40 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1673 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:41.160144 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-87d95dd3-3232-448e-93c8-fefc2af95f95 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:41.162004 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-87d95dd3-3232-448e-93c8-fefc2af95f95 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:41.168726 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-87d95dd3-3232-448e-93c8-fefc2af95f95 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:41.169609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-87d95dd3-3232-448e-93c8-fefc2af95f95 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:41.170636 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-87d95dd3-3232-448e-93c8-fefc2af95f95 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:41.171137 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-87d95dd3-3232-448e-93c8-fefc2af95f95 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:41.328886 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-87d95dd3-3232-448e-93c8-fefc2af95f95 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:41.340395 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-87d95dd3-3232-448e-93c8-fefc2af95f95 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:41.342819 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-87d95dd3-3232-448e-93c8-fefc2af95f95 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:41.345044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-87d95dd3-3232-448e-93c8-fefc2af95f95 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.189511 Jul 12 18:31:41.345747 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 367/689] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:41 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:41.937570 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6442fb8d-6259-443f-89cf-f62e518df035 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:41.938214 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6442fb8d-6259-443f-89cf-f62e518df035 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:41.946083 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6442fb8d-6259-443f-89cf-f62e518df035 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:41.946533 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6442fb8d-6259-443f-89cf-f62e518df035 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:41.947359 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6442fb8d-6259-443f-89cf-f62e518df035 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:41.947807 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6442fb8d-6259-443f-89cf-f62e518df035 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:42.123108 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6442fb8d-6259-443f-89cf-f62e518df035 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:42.131377 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6442fb8d-6259-443f-89cf-f62e518df035 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1673 microversion: 2.1 time: 0.197821 Jul 12 18:31:42.131955 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 323/690] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:41 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1673 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:42.363396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0595e4c1-7f63-4fe6-90f9-b9b8709ebbf2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:42.366109 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0595e4c1-7f63-4fe6-90f9-b9b8709ebbf2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:42.373789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0595e4c1-7f63-4fe6-90f9-b9b8709ebbf2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:42.374453 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0595e4c1-7f63-4fe6-90f9-b9b8709ebbf2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:42.375865 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0595e4c1-7f63-4fe6-90f9-b9b8709ebbf2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:42.376335 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0595e4c1-7f63-4fe6-90f9-b9b8709ebbf2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:42.537435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0595e4c1-7f63-4fe6-90f9-b9b8709ebbf2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:42.546458 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0595e4c1-7f63-4fe6-90f9-b9b8709ebbf2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:42.548891 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0595e4c1-7f63-4fe6-90f9-b9b8709ebbf2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:42.550205 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0595e4c1-7f63-4fe6-90f9-b9b8709ebbf2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.190873 Jul 12 18:31:42.550771 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 368/691] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:42 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:43.149792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-36bb1e36-801f-431d-8f2a-4177ea0104d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:43.151091 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-36bb1e36-801f-431d-8f2a-4177ea0104d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:43.158401 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-36bb1e36-801f-431d-8f2a-4177ea0104d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:43.158848 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-36bb1e36-801f-431d-8f2a-4177ea0104d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:43.159836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-36bb1e36-801f-431d-8f2a-4177ea0104d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:43.160272 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-36bb1e36-801f-431d-8f2a-4177ea0104d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:43.308587 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-36bb1e36-801f-431d-8f2a-4177ea0104d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:43.316762 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-36bb1e36-801f-431d-8f2a-4177ea0104d5 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1673 microversion: 2.1 time: 0.172018 Jul 12 18:31:43.327030 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 324/692] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:43 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:43.570951 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b0d1bc8e-d4a6-430e-92aa-9bc5c88a98cc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:43.571646 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b0d1bc8e-d4a6-430e-92aa-9bc5c88a98cc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:43.578623 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b0d1bc8e-d4a6-430e-92aa-9bc5c88a98cc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:43.578996 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b0d1bc8e-d4a6-430e-92aa-9bc5c88a98cc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:43.579768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b0d1bc8e-d4a6-430e-92aa-9bc5c88a98cc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:43.580205 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b0d1bc8e-d4a6-430e-92aa-9bc5c88a98cc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:43.735806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b0d1bc8e-d4a6-430e-92aa-9bc5c88a98cc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:43.744772 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b0d1bc8e-d4a6-430e-92aa-9bc5c88a98cc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:43.746369 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b0d1bc8e-d4a6-430e-92aa-9bc5c88a98cc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:43.747523 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b0d1bc8e-d4a6-430e-92aa-9bc5c88a98cc tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.180986 Jul 12 18:31:43.748112 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 369/693] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:43 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:44.335608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-059530ef-69c6-427b-b0cd-9fe5998db2ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:44.336222 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-059530ef-69c6-427b-b0cd-9fe5998db2ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:44.343602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-059530ef-69c6-427b-b0cd-9fe5998db2ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:44.344178 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-059530ef-69c6-427b-b0cd-9fe5998db2ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:44.345198 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-059530ef-69c6-427b-b0cd-9fe5998db2ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:44.345702 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-059530ef-69c6-427b-b0cd-9fe5998db2ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:44.508232 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-059530ef-69c6-427b-b0cd-9fe5998db2ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:44.516148 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-059530ef-69c6-427b-b0cd-9fe5998db2ca tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1673 microversion: 2.1 time: 0.185673 Jul 12 18:31:44.516811 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 325/694] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:44 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:44.767388 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9e7b93e6-ef0f-47e7-bdc6-0c3d6f620e79 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:44.767927 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9e7b93e6-ef0f-47e7-bdc6-0c3d6f620e79 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:44.775298 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9e7b93e6-ef0f-47e7-bdc6-0c3d6f620e79 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:44.775884 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9e7b93e6-ef0f-47e7-bdc6-0c3d6f620e79 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:44.776715 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9e7b93e6-ef0f-47e7-bdc6-0c3d6f620e79 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:44.777151 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9e7b93e6-ef0f-47e7-bdc6-0c3d6f620e79 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:44.922110 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9e7b93e6-ef0f-47e7-bdc6-0c3d6f620e79 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:44.931525 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9e7b93e6-ef0f-47e7-bdc6-0c3d6f620e79 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:44.933095 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9e7b93e6-ef0f-47e7-bdc6-0c3d6f620e79 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:44.934368 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9e7b93e6-ef0f-47e7-bdc6-0c3d6f620e79 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.171055 Jul 12 18:31:44.934932 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 370/695] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:44 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:31:45.535093 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3065b7f7-e020-4ce7-9e7f-ad1ae2a4312d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:45.536290 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3065b7f7-e020-4ce7-9e7f-ad1ae2a4312d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:45.543581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3065b7f7-e020-4ce7-9e7f-ad1ae2a4312d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:45.544056 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3065b7f7-e020-4ce7-9e7f-ad1ae2a4312d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:45.544842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3065b7f7-e020-4ce7-9e7f-ad1ae2a4312d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:45.545279 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3065b7f7-e020-4ce7-9e7f-ad1ae2a4312d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:45.704869 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3065b7f7-e020-4ce7-9e7f-ad1ae2a4312d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:45.713786 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3065b7f7-e020-4ce7-9e7f-ad1ae2a4312d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1673 microversion: 2.1 time: 0.182363 Jul 12 18:31:45.724674 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 326/696] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:45 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:45.955601 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-73cdfcfe-a73f-4c6b-a207-b817feeded48 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:45.956151 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-73cdfcfe-a73f-4c6b-a207-b817feeded48 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:45.963553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-73cdfcfe-a73f-4c6b-a207-b817feeded48 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:45.963891 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-73cdfcfe-a73f-4c6b-a207-b817feeded48 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:45.964885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-73cdfcfe-a73f-4c6b-a207-b817feeded48 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:45.965514 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-73cdfcfe-a73f-4c6b-a207-b817feeded48 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:46.146264 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-73cdfcfe-a73f-4c6b-a207-b817feeded48 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:46.155160 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-73cdfcfe-a73f-4c6b-a207-b817feeded48 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:46.156695 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-73cdfcfe-a73f-4c6b-a207-b817feeded48 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:46.157856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-73cdfcfe-a73f-4c6b-a207-b817feeded48 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.207381 Jul 12 18:31:46.158412 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 371/697] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:45 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:31:46.732976 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c69e030f-4663-45d6-b997-fe0a622d3a51 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:46.733634 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c69e030f-4663-45d6-b997-fe0a622d3a51 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:46.740774 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c69e030f-4663-45d6-b997-fe0a622d3a51 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:46.741273 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c69e030f-4663-45d6-b997-fe0a622d3a51 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:46.742088 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c69e030f-4663-45d6-b997-fe0a622d3a51 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:46.742522 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c69e030f-4663-45d6-b997-fe0a622d3a51 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:46.882133 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c69e030f-4663-45d6-b997-fe0a622d3a51 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:46.890138 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c69e030f-4663-45d6-b997-fe0a622d3a51 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1673 microversion: 2.1 time: 0.161031 Jul 12 18:31:46.895986 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 327/698] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:46 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:47.178440 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-693c5ef0-22fa-4a30-837c-251d58602dd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:47.179160 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-693c5ef0-22fa-4a30-837c-251d58602dd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:47.185844 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-693c5ef0-22fa-4a30-837c-251d58602dd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:47.186288 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-693c5ef0-22fa-4a30-837c-251d58602dd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:47.187056 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-693c5ef0-22fa-4a30-837c-251d58602dd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:47.187486 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-693c5ef0-22fa-4a30-837c-251d58602dd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:47.325198 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-693c5ef0-22fa-4a30-837c-251d58602dd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:47.334590 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-693c5ef0-22fa-4a30-837c-251d58602dd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:47.335453 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-693c5ef0-22fa-4a30-837c-251d58602dd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:47.336674 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-693c5ef0-22fa-4a30-837c-251d58602dd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.162461 Jul 12 18:31:47.337236 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 372/699] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:47 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:47.909746 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-878c8bac-d061-4ef3-a426-59be1a155d8a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:47.910370 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-878c8bac-d061-4ef3-a426-59be1a155d8a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:47.919768 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-878c8bac-d061-4ef3-a426-59be1a155d8a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:47.920192 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-878c8bac-d061-4ef3-a426-59be1a155d8a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:47.921814 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-878c8bac-d061-4ef3-a426-59be1a155d8a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:47.922240 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-878c8bac-d061-4ef3-a426-59be1a155d8a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:48.070660 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-878c8bac-d061-4ef3-a426-59be1a155d8a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:48.079418 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-878c8bac-d061-4ef3-a426-59be1a155d8a tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1673 microversion: 2.1 time: 0.174148 Jul 12 18:31:48.080007 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 328/700] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:47 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:48.356866 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4772160c-4bc5-4423-975c-8707e133ec80 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:48.357879 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4772160c-4bc5-4423-975c-8707e133ec80 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:48.361656 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:48.371893 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4772160c-4bc5-4423-975c-8707e133ec80 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:48.372638 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4772160c-4bc5-4423-975c-8707e133ec80 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:48.373920 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4772160c-4bc5-4423-975c-8707e133ec80 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:48.374620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4772160c-4bc5-4423-975c-8707e133ec80 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:48.534007 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4772160c-4bc5-4423-975c-8707e133ec80 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:48.542343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4772160c-4bc5-4423-975c-8707e133ec80 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:48.543839 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4772160c-4bc5-4423-975c-8707e133ec80 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:48.545034 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4772160c-4bc5-4423-975c-8707e133ec80 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.193584 Jul 12 18:31:48.545589 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 373/701] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:48 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:49.097492 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7bed058f-ffda-45e4-9ace-3b3b9be1607d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:49.098406 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7bed058f-ffda-45e4-9ace-3b3b9be1607d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:49.105852 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7bed058f-ffda-45e4-9ace-3b3b9be1607d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:49.106301 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7bed058f-ffda-45e4-9ace-3b3b9be1607d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:49.107080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7bed058f-ffda-45e4-9ace-3b3b9be1607d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:49.107514 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7bed058f-ffda-45e4-9ace-3b3b9be1607d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:49.245645 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7bed058f-ffda-45e4-9ace-3b3b9be1607d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:49.253791 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7bed058f-ffda-45e4-9ace-3b3b9be1607d tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1673 microversion: 2.1 time: 0.160010 Jul 12 18:31:49.254826 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 329/702] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:49 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:49.564528 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5df6613e-a765-4e6a-9a1b-477cf73de452 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:49.565986 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5df6613e-a765-4e6a-9a1b-477cf73de452 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:49.573700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5df6613e-a765-4e6a-9a1b-477cf73de452 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:49.574208 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5df6613e-a765-4e6a-9a1b-477cf73de452 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:49.575051 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5df6613e-a765-4e6a-9a1b-477cf73de452 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:49.575544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5df6613e-a765-4e6a-9a1b-477cf73de452 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:49.782413 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5df6613e-a765-4e6a-9a1b-477cf73de452 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:49.791065 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5df6613e-a765-4e6a-9a1b-477cf73de452 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:49.792603 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5df6613e-a765-4e6a-9a1b-477cf73de452 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:49.793830 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5df6613e-a765-4e6a-9a1b-477cf73de452 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.233382 Jul 12 18:31:49.794412 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 374/703] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:49 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:50.216239 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-c0e76d94-9c9d-4291-b4a2-12b5decd3e9b req-0032c867-e56f-4f5f-9268-c527b9126253 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a", "name": "network-vif-plugged", "status": "completed", "tag": "f5d11a8c-c702-4fa1-8cbd-ab67a930e714"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:31:50.237501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-c0e76d94-9c9d-4291-b4a2-12b5decd3e9b req-0032c867-e56f-4f5f-9268-c527b9126253 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:50.238009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-c0e76d94-9c9d-4291-b4a2-12b5decd3e9b req-0032c867-e56f-4f5f-9268-c527b9126253 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:50.251111 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-c0e76d94-9c9d-4291-b4a2-12b5decd3e9b req-0032c867-e56f-4f5f-9268-c527b9126253 service nova] Creating event network-vif-plugged:f5d11a8c-c702-4fa1-8cbd-ab67a930e714 for instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a on hv-cinder-84488 Jul 12 18:31:50.256204 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-c0e76d94-9c9d-4291-b4a2-12b5decd3e9b req-0032c867-e56f-4f5f-9268-c527b9126253 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043781 Jul 12 18:31:50.257573 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 330/704] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:31:50.273384 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f8fd7733-2c25-499e-b34d-61e270652f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:50.274220 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f8fd7733-2c25-499e-b34d-61e270652f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:50.281002 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8fd7733-2c25-499e-b34d-61e270652f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:50.281385 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8fd7733-2c25-499e-b34d-61e270652f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:50.282169 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8fd7733-2c25-499e-b34d-61e270652f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:50.282603 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f8fd7733-2c25-499e-b34d-61e270652f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:50.372390 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-f5886a09-d321-4995-9c5e-b75997748e78 req-bac45302-9878-4b9e-9024-e0d6c1d88953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7457d661-1f52-4e7d-b723-1f18292c5b9a", "name": "network-vif-deleted", "tag": "ef01d3e7-224f-4391-8b4e-98debf0c76e6"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:31:50.386403 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f5886a09-d321-4995-9c5e-b75997748e78 req-bac45302-9878-4b9e-9024-e0d6c1d88953 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:50.389102 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f5886a09-d321-4995-9c5e-b75997748e78 req-bac45302-9878-4b9e-9024-e0d6c1d88953 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:50.392195 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f8fd7733-2c25-499e-b34d-61e270652f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:50.400730 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f8fd7733-2c25-499e-b34d-61e270652f94 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1605 microversion: 2.1 time: 0.132153 Jul 12 18:31:50.403606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-f5886a09-d321-4995-9c5e-b75997748e78 req-bac45302-9878-4b9e-9024-e0d6c1d88953 service nova] Creating event network-vif-deleted:ef01d3e7-224f-4391-8b4e-98debf0c76e6 for instance 7457d661-1f52-4e7d-b723-1f18292c5b9a on hv-cinder-84488 Jul 12 18:31:50.410006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-f5886a09-d321-4995-9c5e-b75997748e78 req-bac45302-9878-4b9e-9024-e0d6c1d88953 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042554 Jul 12 18:31:50.411875 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 375/705] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:50 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1605 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:50.412471 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 331/706] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:31:50.812955 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ac4aebea-2679-4eb7-aee8-9055c2208541 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:50.813669 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ac4aebea-2679-4eb7-aee8-9055c2208541 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:50.821961 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac4aebea-2679-4eb7-aee8-9055c2208541 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:50.822532 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac4aebea-2679-4eb7-aee8-9055c2208541 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:50.823311 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac4aebea-2679-4eb7-aee8-9055c2208541 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:50.823752 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac4aebea-2679-4eb7-aee8-9055c2208541 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:50.970228 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ac4aebea-2679-4eb7-aee8-9055c2208541 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:50.979871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ac4aebea-2679-4eb7-aee8-9055c2208541 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:50.981408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ac4aebea-2679-4eb7-aee8-9055c2208541 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:50.982658 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ac4aebea-2679-4eb7-aee8-9055c2208541 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.173966 Jul 12 18:31:50.983185 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 376/707] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:50 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:51.419331 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4e19d0cd-75e9-4593-8ed2-04554b5f496f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:51.420025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4e19d0cd-75e9-4593-8ed2-04554b5f496f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:51.427406 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e19d0cd-75e9-4593-8ed2-04554b5f496f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:51.427847 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e19d0cd-75e9-4593-8ed2-04554b5f496f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:51.428670 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e19d0cd-75e9-4593-8ed2-04554b5f496f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:51.429107 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e19d0cd-75e9-4593-8ed2-04554b5f496f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:51.464219 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e19d0cd-75e9-4593-8ed2-04554b5f496f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:51.464598 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e19d0cd-75e9-4593-8ed2-04554b5f496f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:51.465054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-4e19d0cd-75e9-4593-8ed2-04554b5f496f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lazy-loading 'fault' on Instance uuid 7457d661-1f52-4e7d-b723-1f18292c5b9a {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:31:51.514689 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4e19d0cd-75e9-4593-8ed2-04554b5f496f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:51.517930 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4e19d0cd-75e9-4593-8ed2-04554b5f496f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1328 microversion: 2.1 time: 0.103023 Jul 12 18:31:51.518514 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 332/708] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:51 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:52.003102 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c66d30a3-ae9c-4921-93cb-741ee7ea388a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:52.003744 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c66d30a3-ae9c-4921-93cb-741ee7ea388a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:52.011047 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c66d30a3-ae9c-4921-93cb-741ee7ea388a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:52.011482 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c66d30a3-ae9c-4921-93cb-741ee7ea388a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:52.012239 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c66d30a3-ae9c-4921-93cb-741ee7ea388a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:52.012724 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c66d30a3-ae9c-4921-93cb-741ee7ea388a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:52.143045 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c66d30a3-ae9c-4921-93cb-741ee7ea388a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:52.145362 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:52.152000 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c66d30a3-ae9c-4921-93cb-741ee7ea388a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:52.153575 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c66d30a3-ae9c-4921-93cb-741ee7ea388a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:52.154764 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c66d30a3-ae9c-4921-93cb-741ee7ea388a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.155645 Jul 12 18:31:52.155328 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 377/709] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:51 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:52.535418 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-14ff02df-e44a-4784-ab16-7a4bd9f92a1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:52.536751 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-14ff02df-e44a-4784-ab16-7a4bd9f92a1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:52.543890 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-14ff02df-e44a-4784-ab16-7a4bd9f92a1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:52.544364 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-14ff02df-e44a-4784-ab16-7a4bd9f92a1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:52.545166 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-14ff02df-e44a-4784-ab16-7a4bd9f92a1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:52.545600 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-14ff02df-e44a-4784-ab16-7a4bd9f92a1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:52.577341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-14ff02df-e44a-4784-ab16-7a4bd9f92a1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:52.577788 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-14ff02df-e44a-4784-ab16-7a4bd9f92a1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:52.578233 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-14ff02df-e44a-4784-ab16-7a4bd9f92a1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lazy-loading 'fault' on Instance uuid 7457d661-1f52-4e7d-b723-1f18292c5b9a {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:31:52.623184 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-14ff02df-e44a-4784-ab16-7a4bd9f92a1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:52.630945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-14ff02df-e44a-4784-ab16-7a4bd9f92a1f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1328 microversion: 2.1 time: 0.099579 Jul 12 18:31:52.631505 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 333/710] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:52 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:53.174023 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c52e01ef-7325-416f-9ba2-ade445e457c2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:53.174635 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c52e01ef-7325-416f-9ba2-ade445e457c2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:53.182216 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c52e01ef-7325-416f-9ba2-ade445e457c2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:53.182675 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c52e01ef-7325-416f-9ba2-ade445e457c2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:53.183453 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c52e01ef-7325-416f-9ba2-ade445e457c2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:53.183920 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c52e01ef-7325-416f-9ba2-ade445e457c2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:53.320417 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c52e01ef-7325-416f-9ba2-ade445e457c2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:53.328380 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c52e01ef-7325-416f-9ba2-ade445e457c2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:53.329887 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c52e01ef-7325-416f-9ba2-ade445e457c2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:53.331066 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c52e01ef-7325-416f-9ba2-ade445e457c2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.161485 Jul 12 18:31:53.331624 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 378/711] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:53 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:53.652464 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5dcf6c64-27e6-431a-99ae-c5958b32dd6f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:53.653627 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5dcf6c64-27e6-431a-99ae-c5958b32dd6f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:53.665443 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5dcf6c64-27e6-431a-99ae-c5958b32dd6f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:53.666102 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5dcf6c64-27e6-431a-99ae-c5958b32dd6f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:53.667449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5dcf6c64-27e6-431a-99ae-c5958b32dd6f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:53.668266 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5dcf6c64-27e6-431a-99ae-c5958b32dd6f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:53.705466 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5dcf6c64-27e6-431a-99ae-c5958b32dd6f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:53.705850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5dcf6c64-27e6-431a-99ae-c5958b32dd6f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:53.706300 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-5dcf6c64-27e6-431a-99ae-c5958b32dd6f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lazy-loading 'fault' on Instance uuid 7457d661-1f52-4e7d-b723-1f18292c5b9a {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:31:53.755334 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5dcf6c64-27e6-431a-99ae-c5958b32dd6f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:53.763092 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5dcf6c64-27e6-431a-99ae-c5958b32dd6f tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1328 microversion: 2.1 time: 0.118534 Jul 12 18:31:53.763830 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 334/712] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:53 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:54.351039 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ec5af0e8-3c33-4a49-bdf7-42eb899d7c8d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:54.351649 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ec5af0e8-3c33-4a49-bdf7-42eb899d7c8d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:54.359685 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ec5af0e8-3c33-4a49-bdf7-42eb899d7c8d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:54.360205 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ec5af0e8-3c33-4a49-bdf7-42eb899d7c8d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:54.361096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ec5af0e8-3c33-4a49-bdf7-42eb899d7c8d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:54.361621 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ec5af0e8-3c33-4a49-bdf7-42eb899d7c8d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:54.512551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ec5af0e8-3c33-4a49-bdf7-42eb899d7c8d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:54.521710 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ec5af0e8-3c33-4a49-bdf7-42eb899d7c8d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:54.523258 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ec5af0e8-3c33-4a49-bdf7-42eb899d7c8d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:54.524445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ec5af0e8-3c33-4a49-bdf7-42eb899d7c8d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.178028 Jul 12 18:31:54.525033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 379/713] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:54 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:54.780596 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-110851f1-f8fa-4dc6-8a48-f20686bc315e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:54.781215 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-110851f1-f8fa-4dc6-8a48-f20686bc315e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:54.788677 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-110851f1-f8fa-4dc6-8a48-f20686bc315e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:54.790475 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-110851f1-f8fa-4dc6-8a48-f20686bc315e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:54.790475 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-110851f1-f8fa-4dc6-8a48-f20686bc315e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:54.790475 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-110851f1-f8fa-4dc6-8a48-f20686bc315e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:54.814162 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:54.828793 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-110851f1-f8fa-4dc6-8a48-f20686bc315e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:54.829257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-110851f1-f8fa-4dc6-8a48-f20686bc315e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:54.829693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-110851f1-f8fa-4dc6-8a48-f20686bc315e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lazy-loading 'fault' on Instance uuid 7457d661-1f52-4e7d-b723-1f18292c5b9a {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:31:54.873718 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-110851f1-f8fa-4dc6-8a48-f20686bc315e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29bc0d7e30794a6abb292dc65329ed9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00edd8bebc34098919b25aafca8974b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:54.884507 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-110851f1-f8fa-4dc6-8a48-f20686bc315e tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 200 len: 1328 microversion: 2.1 time: 0.107805 Jul 12 18:31:54.885098 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 335/714] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:54 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:31:55.543057 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7d56023b-a9f4-493f-8f7e-0b115aa675a2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:55.545174 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7d56023b-a9f4-493f-8f7e-0b115aa675a2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:55.553049 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7d56023b-a9f4-493f-8f7e-0b115aa675a2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:55.553505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7d56023b-a9f4-493f-8f7e-0b115aa675a2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:55.554279 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7d56023b-a9f4-493f-8f7e-0b115aa675a2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:55.554718 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7d56023b-a9f4-493f-8f7e-0b115aa675a2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:55.699214 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7d56023b-a9f4-493f-8f7e-0b115aa675a2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:55.708609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7d56023b-a9f4-493f-8f7e-0b115aa675a2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:55.710515 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7d56023b-a9f4-493f-8f7e-0b115aa675a2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:55.711912 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7d56023b-a9f4-493f-8f7e-0b115aa675a2 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1729 microversion: 2.20 time: 0.173069 Jul 12 18:31:55.712510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 380/715] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:55 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:31:55.902735 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-176966af-1af0-4c8c-ac98-18a4c4d3bec7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:55.903354 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-176966af-1af0-4c8c-ac98-18a4c4d3bec7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:55.910714 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-176966af-1af0-4c8c-ac98-18a4c4d3bec7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:55.911200 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-176966af-1af0-4c8c-ac98-18a4c4d3bec7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:55.911996 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-176966af-1af0-4c8c-ac98-18a4c4d3bec7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:55.912478 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-176966af-1af0-4c8c-ac98-18a4c4d3bec7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:55.928080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-176966af-1af0-4c8c-ac98-18a4c4d3bec7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] HTTP exception thrown: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-176966af-1af0-4c8c-ac98-18a4c4d3bec7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Request method failure captured: Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a HTTP/1.1 Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyTK2cglfIhsWmClIjvvw0ixT4AZL6zvouNndOncdOPbbmyePUraqqwQ7i69WBCMNeKNwLsq8xkYS0i_RTVxs3mA3f9WqA369AlOyqWWVQYjLuQUuMKYeTGgfL0Sw7KjtMqYc46damKQeCQLDeIfU7KYgUqowR1i2axRS9raAQo1ZQ Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:31:55.929796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d00edd8bebc34098919b25aafca8974b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 29bc0d7e30794a6abb292dc65329ed9e Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:31:55.931276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '7457d661-1f52-4e7d-b723-1f18292c5b9a'} Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:31:55.932082 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:31:55.933440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:31:55.935116 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-176966af-1af0-4c8c-ac98-18a4c4d3bec7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Returning 404 to user: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:31:55.935116 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-176966af-1af0-4c8c-ac98-18a4c4d3bec7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 404 len: 111 microversion: 2.1 time: 0.032765 Jul 12 18:31:55.935116 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 336/716] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:31:55 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:31:55.940753 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-abb203ed-398d-45cd-aa43-925125aea5e7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '.version_select at 0x7f1bb0aab040>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:56.106386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-abb203ed-398d-45cd-aa43-925125aea5e7 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745610182" status: 202 len: 0 microversion: 2.1 time: 0.169601 Jul 12 18:31:56.106976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 381/717] 10.222.0.47 () {58 vars in 1220 bytes} [Tue Jul 12 18:31:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745610182 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:31:56.734890 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0f17196a-73f2-4ac6-b538-4612810c698a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:31:56.736062 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0f17196a-73f2-4ac6-b538-4612810c698a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:31:56.746802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0f17196a-73f2-4ac6-b538-4612810c698a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:56.747605 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0f17196a-73f2-4ac6-b538-4612810c698a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:56.749040 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0f17196a-73f2-4ac6-b538-4612810c698a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:31:56.749828 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0f17196a-73f2-4ac6-b538-4612810c698a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:31:56.900637 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0f17196a-73f2-4ac6-b538-4612810c698a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:56.914557 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0f17196a-73f2-4ac6-b538-4612810c698a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:56.914557 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0f17196a-73f2-4ac6-b538-4612810c698a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:31:56.914557 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0f17196a-73f2-4ac6-b538-4612810c698a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1716 microversion: 2.20 time: 0.186390 Jul 12 18:31:56.915229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 337/718] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:31:56 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1716 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:32:02.769789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ac6d3e62-02e2-4e2d-951c-dd94ebae0910 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:02.770436 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ac6d3e62-02e2-4e2d-951c-dd94ebae0910 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:02.776261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac6d3e62-02e2-4e2d-951c-dd94ebae0910 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:02.776943 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac6d3e62-02e2-4e2d-951c-dd94ebae0910 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:02.777706 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac6d3e62-02e2-4e2d-951c-dd94ebae0910 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:02.778138 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ac6d3e62-02e2-4e2d-951c-dd94ebae0910 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:02.792341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-ac6d3e62-02e2-4e2d-951c-dd94ebae0910 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] HTTP exception thrown: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ac6d3e62-02e2-4e2d-951c-dd94ebae0910 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Request method failure captured: Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: DELETE /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a HTTP/1.1 Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizbyTK2cglfIhsWmClIjvvw0ixT4AZL6zvouNndOncdOPbbmyePUraqqwQ7i69WBCMNeKNwLsq8xkYS0i_RTVxs3mA3f9WqA369AlOyqWWVQYjLuQUuMKYeTGgfL0Sw7KjtMqYc46damKQeCQLDeIfU7KYgUqowR1i2axRS9raAQo1ZQ Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:32:02.794084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d00edd8bebc34098919b25aafca8974b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 29bc0d7e30794a6abb292dc65329ed9e Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:32:02.795571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': '7457d661-1f52-4e7d-b723-1f18292c5b9a'} Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:02.796341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:32:02.798343 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:02.800354 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ac6d3e62-02e2-4e2d-951c-dd94ebae0910 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Returning 404 to user: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:02.800354 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ac6d3e62-02e2-4e2d-951c-dd94ebae0910 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 404 len: 111 microversion: 2.1 time: 0.030271 Jul 12 18:32:02.800354 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 382/719] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:32:02 2022] DELETE /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:32:02.805029 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-27b4a457-d8dd-44e4-a318-d3a31416e2eb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:02.805720 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-27b4a457-d8dd-44e4-a318-d3a31416e2eb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 7457d661-1f52-4e7d-b723-1f18292c5b9a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:02.812580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27b4a457-d8dd-44e4-a318-d3a31416e2eb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:02.813029 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27b4a457-d8dd-44e4-a318-d3a31416e2eb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:02.813795 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27b4a457-d8dd-44e4-a318-d3a31416e2eb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:02.814224 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27b4a457-d8dd-44e4-a318-d3a31416e2eb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:02.828473 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-27b4a457-d8dd-44e4-a318-d3a31416e2eb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] HTTP exception thrown: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-27b4a457-d8dd-44e4-a318-d3a31416e2eb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Request method failure captured: Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a HTTP/1.1 Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyTK2cglfIhsWmClIjvvw0ixT4AZL6zvouNndOncdOPbbmyePUraqqwQ7i69WBCMNeKNwLsq8xkYS0i_RTVxs3mA3f9WqA369AlOyqWWVQYjLuQUuMKYeTGgfL0Sw7KjtMqYc46damKQeCQLDeIfU7KYgUqowR1i2axRS9raAQo1ZQ Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:32:02.830025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d00edd8bebc34098919b25aafca8974b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 29bc0d7e30794a6abb292dc65329ed9e Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:32:02.831611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '7457d661-1f52-4e7d-b723-1f18292c5b9a'} Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:02.832515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. Jul 12 18:32:02.833959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:02.835194 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-27b4a457-d8dd-44e4-a318-d3a31416e2eb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Returning 404 to user: Instance 7457d661-1f52-4e7d-b723-1f18292c5b9a could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:02.835194 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-27b4a457-d8dd-44e4-a318-d3a31416e2eb tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a" status: 404 len: 111 microversion: 2.1 time: 0.031047 Jul 12 18:32:02.835194 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 338/720] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:02 2022] GET /compute/v2.1/servers/7457d661-1f52-4e7d-b723-1f18292c5b9a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:32:04.291856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d77030cc-b7b1-4b93-8acc-b02fc0a0bbf2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:04.296966 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d77030cc-b7b1-4b93-8acc-b02fc0a0bbf2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:04.299049 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d77030cc-b7b1-4b93-8acc-b02fc0a0bbf2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:04.299503 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d77030cc-b7b1-4b93-8acc-b02fc0a0bbf2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:04.300276 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d77030cc-b7b1-4b93-8acc-b02fc0a0bbf2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:04.300746 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d77030cc-b7b1-4b93-8acc-b02fc0a0bbf2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:04.319678 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-d77030cc-b7b1-4b93-8acc-b02fc0a0bbf2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] HTTP exception thrown: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d77030cc-b7b1-4b93-8acc-b02fc0a0bbf2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Request method failure captured: Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: DELETE /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 HTTP/1.1 Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizbyTK2cglfIhsWmClIjvvw0ixT4AZL6zvouNndOncdOPbbmyePUraqqwQ7i69WBCMNeKNwLsq8xkYS0i_RTVxs3mA3f9WqA369AlOyqWWVQYjLuQUuMKYeTGgfL0Sw7KjtMqYc46damKQeCQLDeIfU7KYgUqowR1i2axRS9raAQo1ZQ Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:32:04.321271 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d00edd8bebc34098919b25aafca8974b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 29bc0d7e30794a6abb292dc65329ed9e Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:32:04.322894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': '5f6ad973-f294-4c83-bb32-5d90270ada90'} Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:04.323789 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:32:04.325261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:04.326736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d77030cc-b7b1-4b93-8acc-b02fc0a0bbf2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Returning 404 to user: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:04.326736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d77030cc-b7b1-4b93-8acc-b02fc0a0bbf2 tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 404 len: 111 microversion: 2.1 time: 0.035064 Jul 12 18:32:04.326736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 383/721] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:32:04 2022] DELETE /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:32:04.331618 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-68429aeb-a520-4e5a-a74b-9ac6216275db tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:04.332141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-68429aeb-a520-4e5a-a74b-9ac6216275db tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] [instance: 5f6ad973-f294-4c83-bb32-5d90270ada90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:04.336107 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=54 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:04.339817 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-68429aeb-a520-4e5a-a74b-9ac6216275db tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:04.340271 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-68429aeb-a520-4e5a-a74b-9ac6216275db tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:04.341151 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-68429aeb-a520-4e5a-a74b-9ac6216275db tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:04.341777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-68429aeb-a520-4e5a-a74b-9ac6216275db tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:04.357096 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-68429aeb-a520-4e5a-a74b-9ac6216275db tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] HTTP exception thrown: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-68429aeb-a520-4e5a-a74b-9ac6216275db tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Request method failure captured: Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 HTTP/1.1 Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbyTK2cglfIhsWmClIjvvw0ixT4AZL6zvouNndOncdOPbbmyePUraqqwQ7i69WBCMNeKNwLsq8xkYS0i_RTVxs3mA3f9WqA369AlOyqWWVQYjLuQUuMKYeTGgfL0Sw7KjtMqYc46damKQeCQLDeIfU7KYgUqowR1i2axRS9raAQo1ZQ Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:32:04.358626 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d00edd8bebc34098919b25aafca8974b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d00edd8bebc34098919b25aafca8974b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: d00edd8bebc34098919b25aafca8974b Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-579998859 Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 29bc0d7e30794a6abb292dc65329ed9e Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeTestJSON-579998859-project Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:32:04.360480 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '5f6ad973-f294-4c83-bb32-5d90270ada90'} Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:04.361293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. Jul 12 18:32:04.362613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:04.363739 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-68429aeb-a520-4e5a-a74b-9ac6216275db tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] Returning 404 to user: Instance 5f6ad973-f294-4c83-bb32-5d90270ada90 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:04.363739 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-68429aeb-a520-4e5a-a74b-9ac6216275db tempest-AttachVolumeTestJSON-579998859 tempest-AttachVolumeTestJSON-579998859-project] 10.222.0.47 "GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90" status: 404 len: 111 microversion: 2.1 time: 0.032427 Jul 12 18:32:04.363739 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 339/722] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:04 2022] GET /compute/v2.1/servers/5f6ad973-f294-4c83-bb32-5d90270ada90 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:32:10.574609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-401ca496-db6f-4268-b7d5-13c8b2bc4919 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Action: 'create', calling method: .version_select at 0x7f1bb0d17310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-503512533", "metadata": {"Type": "work"}}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-401ca496-db6f-4268-b7d5-13c8b2bc4919 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Request method failure captured: Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 121 Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb4qgrZUM92zpO2Y9p6LqhPO6f8QXenopLD7dHrairmvTkb-Lv9g5xD0o4oM2GS2AqlAqggxd_TP2sKjwr-_3ifY_bgld8HGELaknLxrC4dOyy2xBZ32ouEjPOVqFnFVN5r8yiJ3GMXWVNKzoq9oMTHGWR28eSb6I7N9HaeoJsjUZNY Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:32:10.606700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/148d1010ef2845eb834df707e583a95c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_148d1010ef2845eb834df707e583a95c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 03a7e1fe9cf94ed4abbafe820ef1f276 Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-503512533", "metadata": {"Type": "work"}}} Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: Jul 12 18:32:10.616689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-503512533', 'metadata': {'Type': 'work'}}}} Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise error Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:10.617798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 18:32:10.619428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 18:32:10.620799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 18:32:10.620799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.620799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-401ca496-db6f-4268-b7d5-13c8b2bc4919 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:10.620799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-401ca496-db6f-4268-b7d5-13c8b2bc4919 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.154526 Jul 12 18:32:10.620799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 384/723] 10.222.0.47 () {60 vars in 1155 bytes} [Tue Jul 12 18:32:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:32:10.625293 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e3aac061-1903-4a72-92d8-326aec384f66 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Action: 'create', calling method: .version_select at 0x7f1bb08d01f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1460467269", "metadata": {"Type": "work"}}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e3aac061-1903-4a72-92d8-326aec384f66 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Request method failure captured: Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 120 Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb4qgrZUM92zpO2Y9p6LqhPO6f8QXenopLD7dHrairmvTkb-Lv9g5xD0o4oM2GS2AqlAqggxd_TP2sKjwr-_3ifY_bgld8HGELaknLxrC4dOyy2xBZ32ouEjPOVqFnFVN5r8yiJ3GMXWVNKzoq9oMTHGWR28eSb6I7N9HaeoJsjUZNY Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:32:10.628459 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/148d1010ef2845eb834df707e583a95c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_148d1010ef2845eb834df707e583a95c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 03a7e1fe9cf94ed4abbafe820ef1f276 Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1460467269", "metadata": {"Type": "work"}}} Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: Jul 12 18:32:10.631244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1460467269', 'metadata': {'Type': 'work'}}}} Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise error Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi '0' Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:10.633809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 18:32:10.638589 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 18:32:10.643947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 18:32:10.643947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.643947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e3aac061-1903-4a72-92d8-326aec384f66 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:10.643947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e3aac061-1903-4a72-92d8-326aec384f66 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015960 Jul 12 18:32:10.643947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 340/724] 10.222.0.47 () {60 vars in 1155 bytes} [Tue Jul 12 18:32:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b70af7f6-5fc6-43f2-a87b-57cf09a6ebbc tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Action: 'create', calling method: .version_select at 0x7f1bb0ae7820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1473685016", "metadata": {"Type": "work"}}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b70af7f6-5fc6-43f2-a87b-57cf09a6ebbc tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Request method failure captured: Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 119 Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb4qgrZUM92zpO2Y9p6LqhPO6f8QXenopLD7dHrairmvTkb-Lv9g5xD0o4oM2GS2AqlAqggxd_TP2sKjwr-_3ifY_bgld8HGELaknLxrC4dOyy2xBZ32ouEjPOVqFnFVN5r8yiJ3GMXWVNKzoq9oMTHGWR28eSb6I7N9HaeoJsjUZNY Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:32:10.646416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/148d1010ef2845eb834df707e583a95c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_148d1010ef2845eb834df707e583a95c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 03a7e1fe9cf94ed4abbafe820ef1f276 Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1473685016", "metadata": {"Type": "work"}}} Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: Jul 12 18:32:10.650199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1473685016', 'metadata': {'Type': 'work'}}}} Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise error Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi '' Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:10.651546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 18:32:10.654133 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 18:32:10.655703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 18:32:10.655703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.655703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b70af7f6-5fc6-43f2-a87b-57cf09a6ebbc tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:10.655703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b70af7f6-5fc6-43f2-a87b-57cf09a6ebbc tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007652 Jul 12 18:32:10.655703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 385/725] 10.222.0.47 () {60 vars in 1155 bytes} [Tue Jul 12 18:32:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:32:10.656163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5db5d0b3-f45c-4460-875e-4fb6b54c563e tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Calling method '.version_select at 0x7f1bb092f280>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:10.684595 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-5db5d0b3-f45c-4460-875e-4fb6b54c563e tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] HTTP exception thrown: Volume tempest-invalid-1044114882 could not be found. Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5db5d0b3-f45c-4460-875e-4fb6b54c563e tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Request method failure captured: Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1044114882 HTTP/1.1 Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb4qgrZUM92zpO2Y9p6LqhPO6f8QXenopLD7dHrairmvTkb-Lv9g5xD0o4oM2GS2AqlAqggxd_TP2sKjwr-_3ifY_bgld8HGELaknLxrC4dOyy2xBZ32ouEjPOVqFnFVN5r8yiJ3GMXWVNKzoq9oMTHGWR28eSb6I7N9HaeoJsjUZNY Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:32:10.686526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/148d1010ef2845eb834df707e583a95c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_148d1010ef2845eb834df707e583a95c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 03a7e1fe9cf94ed4abbafe820ef1f276 Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Volume tempest-invalid-1044114882 could not be found. Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'tempest-invalid-1044114882'} Jul 12 18:32:10.687850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1044114882 could not be found. (HTTP 404) (Request-ID: req-64d54003-940d-490c-a346-ac7ef6b23a80) Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.688685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:32:10.690015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1044114882 could not be found. Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:10.691170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1044114882 could not be found. Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1044114882 could not be found. Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5db5d0b3-f45c-4460-875e-4fb6b54c563e tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Returning 404 to user: Volume tempest-invalid-1044114882 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5db5d0b3-f45c-4460-875e-4fb6b54c563e tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1044114882" status: 404 len: 99 microversion: 2.1 time: 0.038475 Jul 12 18:32:10.693442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 341/726] 10.222.0.47 () {58 vars in 1217 bytes} [Tue Jul 12 18:32:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1044114882 => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 18:32:10.700518 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-beed91ec-4704-4e78-afab-9d0b4d289f08 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003704 Jul 12 18:32:10.701160 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 386/727] 10.222.0.47 () {58 vars in 1139 bytes} [Tue Jul 12 18:32:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 18:32:10.714410 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-20b7200e-4f2f-4228-9a3d-6546a2ba58ba tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003844 Jul 12 18:32:10.714895 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 342/728] 10.222.0.47 () {58 vars in 1136 bytes} [Tue Jul 12 18:32:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 18:32:10.723227 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bb18fe50-d219-4e7d-bd5a-a9866adc9e3b tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Calling method '.version_select at 0x7f1bb0a154c0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:10.751384 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-bb18fe50-d219-4e7d-bd5a-a9866adc9e3b tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] HTTP exception thrown: Volume 36318be3-e46f-4127-a927-8b42dcbaf3da could not be found. Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bb18fe50-d219-4e7d-bd5a-a9866adc9e3b tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Request method failure captured: Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: DELETE /compute/v2.1/os-volumes/36318be3-e46f-4127-a927-8b42dcbaf3da HTTP/1.1 Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb4qgrZUM92zpO2Y9p6LqhPO6f8QXenopLD7dHrairmvTkb-Lv9g5xD0o4oM2GS2AqlAqggxd_TP2sKjwr-_3ifY_bgld8HGELaknLxrC4dOyy2xBZ32ouEjPOVqFnFVN5r8yiJ3GMXWVNKzoq9oMTHGWR28eSb6I7N9HaeoJsjUZNY Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:32:10.753581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/148d1010ef2845eb834df707e583a95c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_148d1010ef2845eb834df707e583a95c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 03a7e1fe9cf94ed4abbafe820ef1f276 Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Volume 36318be3-e46f-4127-a927-8b42dcbaf3da could not be found. Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': '36318be3-e46f-4127-a927-8b42dcbaf3da'} Jul 12 18:32:10.755586 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36318be3-e46f-4127-a927-8b42dcbaf3da could not be found. (HTTP 404) (Request-ID: req-3cef443c-0468-4a21-bd4c-1aa7985c55f9) Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.756780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:32:10.758259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36318be3-e46f-4127-a927-8b42dcbaf3da could not be found. Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 18:32:10.759783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36318be3-e46f-4127-a927-8b42dcbaf3da could not be found. Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36318be3-e46f-4127-a927-8b42dcbaf3da could not be found. Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bb18fe50-d219-4e7d-bd5a-a9866adc9e3b tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Returning 404 to user: Volume 36318be3-e46f-4127-a927-8b42dcbaf3da could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bb18fe50-d219-4e7d-bd5a-a9866adc9e3b tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/36318be3-e46f-4127-a927-8b42dcbaf3da" status: 404 len: 109 microversion: 2.1 time: 0.036579 Jul 12 18:32:10.761598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 387/729] 10.222.0.47 () {58 vars in 1247 bytes} [Tue Jul 12 18:32:10 2022] DELETE /compute/v2.1/os-volumes/36318be3-e46f-4127-a927-8b42dcbaf3da => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:32:10.767646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-35e9b9b5-c8bb-45fa-a478-3d7661b73256 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Calling method '.version_select at 0x7f1bb09b4dc0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:10.795213 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-35e9b9b5-c8bb-45fa-a478-3d7661b73256 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] HTTP exception thrown: Volume 956aa1fc-f492-46d0-96cc-69634b8e0543 could not be found. Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-35e9b9b5-c8bb-45fa-a478-3d7661b73256 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Request method failure captured: Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/os-volumes/956aa1fc-f492-46d0-96cc-69634b8e0543 HTTP/1.1 Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb4qgrZUM92zpO2Y9p6LqhPO6f8QXenopLD7dHrairmvTkb-Lv9g5xD0o4oM2GS2AqlAqggxd_TP2sKjwr-_3ifY_bgld8HGELaknLxrC4dOyy2xBZ32ouEjPOVqFnFVN5r8yiJ3GMXWVNKzoq9oMTHGWR28eSb6I7N9HaeoJsjUZNY Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:32:10.797262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/148d1010ef2845eb834df707e583a95c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_148d1010ef2845eb834df707e583a95c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/148d1010ef2845eb834df707e583a95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 148d1010ef2845eb834df707e583a95c Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesNegativeTest-688905032 Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 03a7e1fe9cf94ed4abbafe820ef1f276 Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesNegativeTest-688905032-project Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Volume 956aa1fc-f492-46d0-96cc-69634b8e0543 could not be found. Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '956aa1fc-f492-46d0-96cc-69634b8e0543'} Jul 12 18:32:10.798581 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 956aa1fc-f492-46d0-96cc-69634b8e0543 could not be found. (HTTP 404) (Request-ID: req-135bed3c-e499-456c-a309-0bd129884410) Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.799407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:32:10.805448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 956aa1fc-f492-46d0-96cc-69634b8e0543 could not be found. Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 18:32:10.806777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 956aa1fc-f492-46d0-96cc-69634b8e0543 could not be found. Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 956aa1fc-f492-46d0-96cc-69634b8e0543 could not be found. Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-35e9b9b5-c8bb-45fa-a478-3d7661b73256 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] Returning 404 to user: Volume 956aa1fc-f492-46d0-96cc-69634b8e0543 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-35e9b9b5-c8bb-45fa-a478-3d7661b73256 tempest-VolumesNegativeTest-688905032 tempest-VolumesNegativeTest-688905032-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/956aa1fc-f492-46d0-96cc-69634b8e0543" status: 404 len: 109 microversion: 2.1 time: 0.036947 Jul 12 18:32:10.807949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 343/730] 10.222.0.47 () {58 vars in 1244 bytes} [Tue Jul 12 18:32:10 2022] GET /compute/v2.1/os-volumes/956aa1fc-f492-46d0-96cc-69634b8e0543 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:32:13.789004 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1013203019", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "networks": [{"uuid": "c61fcf91-5797-4951-9e2f-81d214fdaefa"}]}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:32:13.843493 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] validate_networks() for [('c61fcf91-5797-4951-9e2f-81d214fdaefa', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:32:14.214527 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:32:14.214951 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:32:14.215422 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:32:14.215827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:32:14.216265 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:32:14.225373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:14.225819 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:14.226620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:14.227083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:14.244663 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Getting quotas for project 246cc971eb1a4882868c39c39d27e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:32:14.248599 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Getting quotas for user 38c44ad4254a46beba4a8a2ca5175f82 and project 246cc971eb1a4882868c39c39d27e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:32:14.260896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:32:14.264226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:32:14.403764 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9a8a7369-1060-4f1c-92ef-32bcd015d7aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620055 Jul 12 18:32:14.404439 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 388/731] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:32:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:32:14.411935 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=16 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:14.416783 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1ce59d60-8422-4326-b277-fbee8598b892 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:14.417384 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1ce59d60-8422-4326-b277-fbee8598b892 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:14.489487 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1ce59d60-8422-4326-b277-fbee8598b892 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:14.494854 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1ce59d60-8422-4326-b277-fbee8598b892 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1219 microversion: 2.1 time: 0.084229 Jul 12 18:32:14.495574 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 344/732] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:14 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:15.512148 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c8ff870d-853c-422b-a27e-5f2f6cff71d6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:15.512751 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c8ff870d-853c-422b-a27e-5f2f6cff71d6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:15.520408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c8ff870d-853c-422b-a27e-5f2f6cff71d6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:15.520870 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c8ff870d-853c-422b-a27e-5f2f6cff71d6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:15.521650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c8ff870d-853c-422b-a27e-5f2f6cff71d6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:15.522087 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c8ff870d-853c-422b-a27e-5f2f6cff71d6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:15.585005 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c8ff870d-853c-422b-a27e-5f2f6cff71d6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:15.593711 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c8ff870d-853c-422b-a27e-5f2f6cff71d6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1223 microversion: 2.1 time: 0.086040 Jul 12 18:32:15.595178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 389/733] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:15 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:16.611374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7cca453d-04f3-4145-8058-3b94b3450e74 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:16.612064 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7cca453d-04f3-4145-8058-3b94b3450e74 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:16.618981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7cca453d-04f3-4145-8058-3b94b3450e74 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:16.623278 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7cca453d-04f3-4145-8058-3b94b3450e74 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:16.623278 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7cca453d-04f3-4145-8058-3b94b3450e74 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:16.623278 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7cca453d-04f3-4145-8058-3b94b3450e74 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:16.691658 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7cca453d-04f3-4145-8058-3b94b3450e74 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:16.709911 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7cca453d-04f3-4145-8058-3b94b3450e74 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1271 microversion: 2.1 time: 0.102644 Jul 12 18:32:16.710721 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 345/734] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:16 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:32:17.730142 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3544738c-ef01-4c29-81e2-b2d51dc1c9a3 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:17.730879 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3544738c-ef01-4c29-81e2-b2d51dc1c9a3 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:17.737463 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3544738c-ef01-4c29-81e2-b2d51dc1c9a3 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:17.737921 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3544738c-ef01-4c29-81e2-b2d51dc1c9a3 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:17.738660 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3544738c-ef01-4c29-81e2-b2d51dc1c9a3 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:17.739085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3544738c-ef01-4c29-81e2-b2d51dc1c9a3 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:17.893733 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3544738c-ef01-4c29-81e2-b2d51dc1c9a3 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:17.915903 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3544738c-ef01-4c29-81e2-b2d51dc1c9a3 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1319 microversion: 2.1 time: 0.175920 Jul 12 18:32:17.915903 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 390/735] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:17 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:18.830566 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-84b7f1a6-eb0f-4b28-8bec-9343bba4c8c1 req-0e8832e5-7b46-43e7-bdba-aa146d9bd71e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23209fec-1327-4d01-b7fc-289c81646051", "tag": "10475ea0-db7e-489c-b80b-a48825afbaeb"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:32:18.842376 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-84b7f1a6-eb0f-4b28-8bec-9343bba4c8c1 req-0e8832e5-7b46-43e7-bdba-aa146d9bd71e service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:18.843211 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-84b7f1a6-eb0f-4b28-8bec-9343bba4c8c1 req-0e8832e5-7b46-43e7-bdba-aa146d9bd71e service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:18.863438 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-84b7f1a6-eb0f-4b28-8bec-9343bba4c8c1 req-0e8832e5-7b46-43e7-bdba-aa146d9bd71e service nova] Creating event network-changed:10475ea0-db7e-489c-b80b-a48825afbaeb for instance 23209fec-1327-4d01-b7fc-289c81646051 on hv-cinder-84488 Jul 12 18:32:18.869930 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-84b7f1a6-eb0f-4b28-8bec-9343bba4c8c1 req-0e8832e5-7b46-43e7-bdba-aa146d9bd71e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045336 Jul 12 18:32:18.870529 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 346/736] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:32:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:32:18.920015 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2a320039-ba5e-416f-af6c-a8c920c4dc42 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:18.921296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2a320039-ba5e-416f-af6c-a8c920c4dc42 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:18.928712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2a320039-ba5e-416f-af6c-a8c920c4dc42 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:18.929164 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2a320039-ba5e-416f-af6c-a8c920c4dc42 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:18.929967 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2a320039-ba5e-416f-af6c-a8c920c4dc42 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:18.930651 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2a320039-ba5e-416f-af6c-a8c920c4dc42 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:19.212900 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2a320039-ba5e-416f-af6c-a8c920c4dc42 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:19.220704 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2a320039-ba5e-416f-af6c-a8c920c4dc42 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1319 microversion: 2.1 time: 0.305403 Jul 12 18:32:19.221288 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 391/737] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:18 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:20.238652 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1d840fe6-31b6-47c2-b36f-6064b7c4f498 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:20.239382 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1d840fe6-31b6-47c2-b36f-6064b7c4f498 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:20.246934 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1d840fe6-31b6-47c2-b36f-6064b7c4f498 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:20.247370 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1d840fe6-31b6-47c2-b36f-6064b7c4f498 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:20.248116 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1d840fe6-31b6-47c2-b36f-6064b7c4f498 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:20.248559 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1d840fe6-31b6-47c2-b36f-6064b7c4f498 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:20.382981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1d840fe6-31b6-47c2-b36f-6064b7c4f498 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:20.391094 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1d840fe6-31b6-47c2-b36f-6064b7c4f498 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1319 microversion: 2.1 time: 0.157254 Jul 12 18:32:20.391948 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 347/738] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:20 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:21.408526 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4041d155-107b-424b-827f-ca15112644ef tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:21.409138 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4041d155-107b-424b-827f-ca15112644ef tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:21.411552 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:21.416654 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4041d155-107b-424b-827f-ca15112644ef tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:21.417927 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4041d155-107b-424b-827f-ca15112644ef tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:21.417927 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4041d155-107b-424b-827f-ca15112644ef tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:21.418327 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4041d155-107b-424b-827f-ca15112644ef tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:21.554322 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4041d155-107b-424b-827f-ca15112644ef tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:21.561957 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4041d155-107b-424b-827f-ca15112644ef tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1319 microversion: 2.1 time: 0.157382 Jul 12 18:32:21.567315 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 392/739] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:21 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:22.582046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b1594917-ec1a-4ee8-afcd-d455ad3f7ef9 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:22.582723 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b1594917-ec1a-4ee8-afcd-d455ad3f7ef9 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:22.589397 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1594917-ec1a-4ee8-afcd-d455ad3f7ef9 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:22.589836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1594917-ec1a-4ee8-afcd-d455ad3f7ef9 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:22.590590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1594917-ec1a-4ee8-afcd-d455ad3f7ef9 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:22.591013 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1594917-ec1a-4ee8-afcd-d455ad3f7ef9 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:22.724994 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b1594917-ec1a-4ee8-afcd-d455ad3f7ef9 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:22.732995 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b1594917-ec1a-4ee8-afcd-d455ad3f7ef9 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1319 microversion: 2.1 time: 0.154928 Jul 12 18:32:22.733558 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 348/740] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:22 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:23.750704 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-dd3ccba2-4333-4dad-8f6d-c7fc0b843bda tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:23.751707 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-dd3ccba2-4333-4dad-8f6d-c7fc0b843bda tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:23.758140 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dd3ccba2-4333-4dad-8f6d-c7fc0b843bda tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:23.758584 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dd3ccba2-4333-4dad-8f6d-c7fc0b843bda tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:23.759921 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dd3ccba2-4333-4dad-8f6d-c7fc0b843bda tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:23.760384 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dd3ccba2-4333-4dad-8f6d-c7fc0b843bda tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:23.764276 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=50 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:23.897739 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-dd3ccba2-4333-4dad-8f6d-c7fc0b843bda tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:23.905352 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-dd3ccba2-4333-4dad-8f6d-c7fc0b843bda tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1319 microversion: 2.1 time: 0.159155 Jul 12 18:32:23.905909 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 393/741] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:23 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:24.482699 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-26ff9fa2-c357-495f-8bd3-f579f9132332 req-009acc6c-7784-4199-b5c6-43d09342a702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23209fec-1327-4d01-b7fc-289c81646051", "name": "network-vif-plugged", "status": "completed", "tag": "10475ea0-db7e-489c-b80b-a48825afbaeb"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:32:24.490968 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-26ff9fa2-c357-495f-8bd3-f579f9132332 req-009acc6c-7784-4199-b5c6-43d09342a702 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:24.491407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-26ff9fa2-c357-495f-8bd3-f579f9132332 req-009acc6c-7784-4199-b5c6-43d09342a702 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:24.496201 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:24.503341 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-26ff9fa2-c357-495f-8bd3-f579f9132332 req-009acc6c-7784-4199-b5c6-43d09342a702 service nova] Creating event network-vif-plugged:10475ea0-db7e-489c-b80b-a48825afbaeb for instance 23209fec-1327-4d01-b7fc-289c81646051 on hv-cinder-84488 Jul 12 18:32:24.508513 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-26ff9fa2-c357-495f-8bd3-f579f9132332 req-009acc6c-7784-4199-b5c6-43d09342a702 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031287 Jul 12 18:32:24.509350 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 349/742] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:32:24.922321 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-30ca06d7-da36-44f6-ae4f-7d7a830a55a0 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:24.923091 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-30ca06d7-da36-44f6-ae4f-7d7a830a55a0 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:24.925179 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:24.925921 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=6 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:24.931824 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30ca06d7-da36-44f6-ae4f-7d7a830a55a0 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:24.932269 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30ca06d7-da36-44f6-ae4f-7d7a830a55a0 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:24.933103 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30ca06d7-da36-44f6-ae4f-7d7a830a55a0 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:24.933526 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30ca06d7-da36-44f6-ae4f-7d7a830a55a0 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:25.070861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-30ca06d7-da36-44f6-ae4f-7d7a830a55a0 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:25.078932 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-30ca06d7-da36-44f6-ae4f-7d7a830a55a0 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1319 microversion: 2.1 time: 0.160671 Jul 12 18:32:25.079437 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 394/743] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:24 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:26.096986 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fae9eb90-5305-486e-8471-b2c269ce6648 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:26.097672 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fae9eb90-5305-486e-8471-b2c269ce6648 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:26.105707 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fae9eb90-5305-486e-8471-b2c269ce6648 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:26.106231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fae9eb90-5305-486e-8471-b2c269ce6648 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:26.106987 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fae9eb90-5305-486e-8471-b2c269ce6648 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:26.107533 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fae9eb90-5305-486e-8471-b2c269ce6648 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:26.242385 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fae9eb90-5305-486e-8471-b2c269ce6648 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:26.250072 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fae9eb90-5305-486e-8471-b2c269ce6648 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1319 microversion: 2.1 time: 0.157397 Jul 12 18:32:26.250726 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 350/744] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:26 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:27.267919 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4d7898b5-f350-4812-8069-41318c71ac39 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:27.268505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4d7898b5-f350-4812-8069-41318c71ac39 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:27.275662 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d7898b5-f350-4812-8069-41318c71ac39 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:27.276323 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d7898b5-f350-4812-8069-41318c71ac39 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:27.277144 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d7898b5-f350-4812-8069-41318c71ac39 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:27.277577 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4d7898b5-f350-4812-8069-41318c71ac39 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:27.409445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4d7898b5-f350-4812-8069-41318c71ac39 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:27.417538 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4d7898b5-f350-4812-8069-41318c71ac39 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1508 microversion: 2.1 time: 0.154057 Jul 12 18:32:27.422188 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 395/745] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:27 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:29.595582 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-88fec712-e5d6-435d-b9c1-db5193f3bbd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:29.596543 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-88fec712-e5d6-435d-b9c1-db5193f3bbd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:29.603188 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-88fec712-e5d6-435d-b9c1-db5193f3bbd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:29.603615 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-88fec712-e5d6-435d-b9c1-db5193f3bbd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:29.604889 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-88fec712-e5d6-435d-b9c1-db5193f3bbd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:29.604889 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-88fec712-e5d6-435d-b9c1-db5193f3bbd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:29.633370 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-88fec712-e5d6-435d-b9c1-db5193f3bbd8 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041775 Jul 12 18:32:29.633934 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 351/746] 10.222.0.47 () {60 vars in 1342 bytes} [Tue Jul 12 18:32:29 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:29.694938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b78b82b1-7338-4604-b2f7-3bc095f673ab tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:29.695465 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b78b82b1-7338-4604-b2f7-3bc095f673ab tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:29.702831 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b78b82b1-7338-4604-b2f7-3bc095f673ab tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:29.703283 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b78b82b1-7338-4604-b2f7-3bc095f673ab tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:29.704047 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b78b82b1-7338-4604-b2f7-3bc095f673ab tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:29.704514 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b78b82b1-7338-4604-b2f7-3bc095f673ab tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:29.730477 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b78b82b1-7338-4604-b2f7-3bc095f673ab tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:32:30.081456 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b78b82b1-7338-4604-b2f7-3bc095f673ab tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 204 len: 0 microversion: 2.20 time: 0.389934 Jul 12 18:32:30.081970 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 396/747] 10.222.0.47 () {60 vars in 1279 bytes} [Tue Jul 12 18:32:29 2022] DELETE /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 18:32:30.090144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-347e2ea8-220e-4632-8cb8-3bbf921157bf tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:30.090756 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-347e2ea8-220e-4632-8cb8-3bbf921157bf tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:30.096842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-347e2ea8-220e-4632-8cb8-3bbf921157bf tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:30.097285 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-347e2ea8-220e-4632-8cb8-3bbf921157bf tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:30.098040 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-347e2ea8-220e-4632-8cb8-3bbf921157bf tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:30.098469 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-347e2ea8-220e-4632-8cb8-3bbf921157bf tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:30.235908 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-347e2ea8-220e-4632-8cb8-3bbf921157bf tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:30.244174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-347e2ea8-220e-4632-8cb8-3bbf921157bf tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:30.245734 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-347e2ea8-220e-4632-8cb8-3bbf921157bf tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:30.247505 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-347e2ea8-220e-4632-8cb8-3bbf921157bf tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1722 microversion: 2.20 time: 0.161206 Jul 12 18:32:30.248187 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 352/748] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:32:30 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:32:31.267024 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-81e9d7ac-55a0-494f-a865-cb9faaaec67d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:31.271669 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-81e9d7ac-55a0-494f-a865-cb9faaaec67d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:31.274292 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81e9d7ac-55a0-494f-a865-cb9faaaec67d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:31.274740 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81e9d7ac-55a0-494f-a865-cb9faaaec67d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:31.275499 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81e9d7ac-55a0-494f-a865-cb9faaaec67d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:31.275934 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-81e9d7ac-55a0-494f-a865-cb9faaaec67d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:31.417062 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-81e9d7ac-55a0-494f-a865-cb9faaaec67d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:31.428869 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-81e9d7ac-55a0-494f-a865-cb9faaaec67d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:31.431142 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-81e9d7ac-55a0-494f-a865-cb9faaaec67d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:31.432716 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-81e9d7ac-55a0-494f-a865-cb9faaaec67d tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1722 microversion: 2.20 time: 0.170138 Jul 12 18:32:31.433497 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 397/749] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:32:31 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:32:32.453854 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7a574be3-6148-41e4-ad37-6e58a81f1189 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:32.455156 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7a574be3-6148-41e4-ad37-6e58a81f1189 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:32.462436 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a574be3-6148-41e4-ad37-6e58a81f1189 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:32.463209 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a574be3-6148-41e4-ad37-6e58a81f1189 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:32.463988 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a574be3-6148-41e4-ad37-6e58a81f1189 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:32.464448 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a574be3-6148-41e4-ad37-6e58a81f1189 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:32.563975 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7a574be3-6148-41e4-ad37-6e58a81f1189 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:32.572955 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7a574be3-6148-41e4-ad37-6e58a81f1189 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:32.574476 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7a574be3-6148-41e4-ad37-6e58a81f1189 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:32.576267 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7a574be3-6148-41e4-ad37-6e58a81f1189 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1656 microversion: 2.20 time: 0.127896 Jul 12 18:32:32.577282 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 353/750] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:32:32 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1656 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:32:32.775861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-a937921a-33db-4ca9-8c0f-de65289beb35 req-020639e0-267f-42d4-8dc7-869886e97e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a", "name": "network-vif-deleted", "tag": "f5d11a8c-c702-4fa1-8cbd-ab67a930e714"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:32:32.791324 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-a937921a-33db-4ca9-8c0f-de65289beb35 req-020639e0-267f-42d4-8dc7-869886e97e83 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:32.792049 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-a937921a-33db-4ca9-8c0f-de65289beb35 req-020639e0-267f-42d4-8dc7-869886e97e83 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:32.804510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-a937921a-33db-4ca9-8c0f-de65289beb35 req-020639e0-267f-42d4-8dc7-869886e97e83 service nova] Creating event network-vif-deleted:f5d11a8c-c702-4fa1-8cbd-ab67a930e714 for instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a on hv-cinder-84488 Jul 12 18:32:32.814028 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-a937921a-33db-4ca9-8c0f-de65289beb35 req-020639e0-267f-42d4-8dc7-869886e97e83 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042850 Jul 12 18:32:32.814769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 398/751] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:32:33.597891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:33.598537 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:33.618987 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:33.620301 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:33.622191 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:33.622622 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:33.666766 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:33.667580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:33.668371 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lazy-loading 'fault' on Instance uuid f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:32:33.722807 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:33.735966 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:33.742958 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5148114d71b401ca20f988485fb6c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '775c525b714e4f13ac5f34314243fe93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:33.742958 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-366fcc40-db05-4653-91f6-ec419493c61a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 200 len: 1370 microversion: 2.20 time: 0.145642 Jul 12 18:32:33.742958 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 354/752] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:32:33 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:32:34.761581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6d6b55c3-78e0-4c50-9898-7cfb4d9bb5a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:34.762280 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6d6b55c3-78e0-4c50-9898-7cfb4d9bb5a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:34.768603 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6d6b55c3-78e0-4c50-9898-7cfb4d9bb5a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:34.769054 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6d6b55c3-78e0-4c50-9898-7cfb4d9bb5a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:34.775308 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6d6b55c3-78e0-4c50-9898-7cfb4d9bb5a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:34.775308 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6d6b55c3-78e0-4c50-9898-7cfb4d9bb5a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:34.783851 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-6d6b55c3-78e0-4c50-9898-7cfb4d9bb5a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] HTTP exception thrown: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6d6b55c3-78e0-4c50-9898-7cfb4d9bb5a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Request method failure captured: Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a HTTP/1.1 Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizbySjaUoQoYwJrd50L_CYSWxAfEM9A7_CFwU-hJTuVOrvE-mC5tpxmNayRhCK6hK5oGwnAwvx14AxsrbhJp-zax7RroLEzbZLPLTmQlzkX2Iz44iN5jb8MU316ZpmfXtmbF2mta299ZqaGO6IfOFB6XBMF6JfXwgAE0uiZLE4es8rCE Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:32:34.785745 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_775c525b714e4f13ac5f34314243fe93", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: d5148114d71b401ca20f988485fb6c88 Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:34.787510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': 'f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a'} Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:34.788480 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:34.790021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:34.791387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6d6b55c3-78e0-4c50-9898-7cfb4d9bb5a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Returning 404 to user: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:34.791387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6d6b55c3-78e0-4c50-9898-7cfb4d9bb5a3 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 404 len: 111 microversion: 2.20 time: 0.030438 Jul 12 18:32:34.791387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 399/753] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:32:34 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:32:34.797239 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-afd9c15a-04b8-4d91-93ce-0f502fb5f752 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '.version_select at 0x7f1bb14aaca0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:34.894272 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-afd9c15a-04b8-4d91-93ce-0f502fb5f752 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-835920882" status: 204 len: 0 microversion: 2.20 time: 0.101547 Jul 12 18:32:34.894904 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 355/754] 10.222.0.47 () {60 vars in 1258 bytes} [Tue Jul 12 18:32:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-835920882 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 18:32:37.175297 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8acdcaf0-3973-4ade-9591-45f0ae28f760 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:37.175845 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8acdcaf0-3973-4ade-9591-45f0ae28f760 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:37.182886 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8acdcaf0-3973-4ade-9591-45f0ae28f760 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:37.183340 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8acdcaf0-3973-4ade-9591-45f0ae28f760 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:37.184104 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8acdcaf0-3973-4ade-9591-45f0ae28f760 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:37.184566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8acdcaf0-3973-4ade-9591-45f0ae28f760 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:37.205997 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-8acdcaf0-3973-4ade-9591-45f0ae28f760 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] HTTP exception thrown: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8acdcaf0-3973-4ade-9591-45f0ae28f760 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Request method failure captured: Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: DELETE /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a HTTP/1.1 Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizbySjaUoQoYwJrd50L_CYSWxAfEM9A7_CFwU-hJTuVOrvE-mC5tpxmNayRhCK6hK5oGwnAwvx14AxsrbhJp-zax7RroLEzbZLPLTmQlzkX2Iz44iN5jb8MU316ZpmfXtmbF2mta299ZqaGO6IfOFB6XBMF6JfXwgAE0uiZLE4es8rCE Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:32:37.207547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_775c525b714e4f13ac5f34314243fe93", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: d5148114d71b401ca20f988485fb6c88 Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:37.209191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': 'f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a'} Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:37.210060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:37.211553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:37.217313 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8acdcaf0-3973-4ade-9591-45f0ae28f760 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Returning 404 to user: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:37.217313 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8acdcaf0-3973-4ade-9591-45f0ae28f760 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 404 len: 111 microversion: 2.20 time: 0.038384 Jul 12 18:32:37.217313 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 400/755] 10.222.0.47 () {60 vars in 1279 bytes} [Tue Jul 12 18:32:37 2022] DELETE /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:32:37.225240 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8a94f03f-4f3c-498e-bafe-2ae04c95a71a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:37.225859 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8a94f03f-4f3c-498e-bafe-2ae04c95a71a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:37.233182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a94f03f-4f3c-498e-bafe-2ae04c95a71a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:37.233640 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a94f03f-4f3c-498e-bafe-2ae04c95a71a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:37.234399 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a94f03f-4f3c-498e-bafe-2ae04c95a71a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:37.234824 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a94f03f-4f3c-498e-bafe-2ae04c95a71a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:37.248262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-8a94f03f-4f3c-498e-bafe-2ae04c95a71a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] HTTP exception thrown: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8a94f03f-4f3c-498e-bafe-2ae04c95a71a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Request method failure captured: Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a HTTP/1.1 Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbySjaUoQoYwJrd50L_CYSWxAfEM9A7_CFwU-hJTuVOrvE-mC5tpxmNayRhCK6hK5oGwnAwvx14AxsrbhJp-zax7RroLEzbZLPLTmQlzkX2Iz44iN5jb8MU316ZpmfXtmbF2mta299ZqaGO6IfOFB6XBMF6JfXwgAE0uiZLE4es8rCE Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:32:37.249922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_775c525b714e4f13ac5f34314243fe93", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: d5148114d71b401ca20f988485fb6c88 Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:37.251809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a'} Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:37.252687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. Jul 12 18:32:37.254006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:37.255139 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8a94f03f-4f3c-498e-bafe-2ae04c95a71a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Returning 404 to user: Instance f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:37.255139 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8a94f03f-4f3c-498e-bafe-2ae04c95a71a tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a" status: 404 len: 111 microversion: 2.20 time: 0.031343 Jul 12 18:32:37.255139 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 356/756] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:32:37 2022] GET /compute/v2.1/servers/f7f8d9f8-2a50-4b5d-8645-5c94d73c5a1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:32:40.608636 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d915d8f7-fd7a-4e87-b218-51a6f1777b55 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:40.609194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d915d8f7-fd7a-4e87-b218-51a6f1777b55 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:40.616137 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d915d8f7-fd7a-4e87-b218-51a6f1777b55 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:40.616607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d915d8f7-fd7a-4e87-b218-51a6f1777b55 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:40.617374 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d915d8f7-fd7a-4e87-b218-51a6f1777b55 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:40.617808 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d915d8f7-fd7a-4e87-b218-51a6f1777b55 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:40.633935 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-d915d8f7-fd7a-4e87-b218-51a6f1777b55 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] HTTP exception thrown: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d915d8f7-fd7a-4e87-b218-51a6f1777b55 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Request method failure captured: Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: DELETE /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf HTTP/1.1 Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizbySjaUoQoYwJrd50L_CYSWxAfEM9A7_CFwU-hJTuVOrvE-mC5tpxmNayRhCK6hK5oGwnAwvx14AxsrbhJp-zax7RroLEzbZLPLTmQlzkX2Iz44iN5jb8MU316ZpmfXtmbF2mta299ZqaGO6IfOFB6XBMF6JfXwgAE0uiZLE4es8rCE Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:32:40.639387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_775c525b714e4f13ac5f34314243fe93", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: d5148114d71b401ca20f988485fb6c88 Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:32:40.640801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': 'fa637fee-4d51-4d79-aed2-ed75805784bf'} Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:40.641627 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:32:40.644534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:32:40.646074 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d915d8f7-fd7a-4e87-b218-51a6f1777b55 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Returning 404 to user: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:40.646074 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d915d8f7-fd7a-4e87-b218-51a6f1777b55 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 404 len: 111 microversion: 2.20 time: 0.034540 Jul 12 18:32:40.646074 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 401/757] 10.222.0.47 () {60 vars in 1279 bytes} [Tue Jul 12 18:32:40 2022] DELETE /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:32:40.648153 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-87418e3e-4304-42a3-8ec4-6643ef9e13d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:40.648806 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-87418e3e-4304-42a3-8ec4-6643ef9e13d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] [instance: fa637fee-4d51-4d79-aed2-ed75805784bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:40.655447 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-87418e3e-4304-42a3-8ec4-6643ef9e13d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:40.655886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-87418e3e-4304-42a3-8ec4-6643ef9e13d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:40.656725 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-87418e3e-4304-42a3-8ec4-6643ef9e13d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:40.657152 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-87418e3e-4304-42a3-8ec4-6643ef9e13d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:40.670338 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-87418e3e-4304-42a3-8ec4-6643ef9e13d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] HTTP exception thrown: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-87418e3e-4304-42a3-8ec4-6643ef9e13d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Request method failure captured: Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf HTTP/1.1 Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizbySjaUoQoYwJrd50L_CYSWxAfEM9A7_CFwU-hJTuVOrvE-mC5tpxmNayRhCK6hK5oGwnAwvx14AxsrbhJp-zax7RroLEzbZLPLTmQlzkX2Iz44iN5jb8MU316ZpmfXtmbF2mta299ZqaGO6IfOFB6XBMF6JfXwgAE0uiZLE4es8rCE Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:32:40.672190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_775c525b714e4f13ac5f34314243fe93", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/775c525b714e4f13ac5f34314243fe93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 775c525b714e4f13ac5f34314243fe93 Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1316341014 Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: d5148114d71b401ca20f988485fb6c88 Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1316341014-project Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:32:40.674160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'fa637fee-4d51-4d79-aed2-ed75805784bf'} Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:32:40.675315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. Jul 12 18:32:40.676805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:32:40.683138 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-87418e3e-4304-42a3-8ec4-6643ef9e13d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] Returning 404 to user: Instance fa637fee-4d51-4d79-aed2-ed75805784bf could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:32:40.683138 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-87418e3e-4304-42a3-8ec4-6643ef9e13d1 tempest-AttachVolumeShelveTestJSON-1316341014 tempest-AttachVolumeShelveTestJSON-1316341014-project] 10.222.0.47 "GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf" status: 404 len: 111 microversion: 2.20 time: 0.031497 Jul 12 18:32:40.683138 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 357/758] 10.222.0.47 () {60 vars in 1276 bytes} [Tue Jul 12 18:32:40 2022] GET /compute/v2.1/servers/fa637fee-4d51-4d79-aed2-ed75805784bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:32:52.481071 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:52.481834 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:52.616999 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f9472a1c-20f3-4a4c-bf28-17404317be46 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c06343a7-fa46-4916-9738-d6d8d52534bb", "device": "/dev/sdb"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:32:52.618559 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f9472a1c-20f3-4a4c-bf28-17404317be46 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:52.620268 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0fae9d11-e156-45d6-bef5-8937328fd847 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: .version_select at 0x7f1bb0a15670>, body: {"keypair": {"name": "tempest-keypair-82334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEafIEMxYDiAOE1Ko1h+hBN1KlDcMOhqF5NNnyTJGS9imubQVM9bsnENngyDo/1Hg0eYjxxDslBv1wEKWLOZ3pO7GRYrv3MNJBUIoIuQ/pToAj2cJwin5vdQlQB8I0+Esg=="}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:32:52.621169 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:52.621948 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=58 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:52.628895 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9472a1c-20f3-4a4c-bf28-17404317be46 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:52.629590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9472a1c-20f3-4a4c-bf28-17404317be46 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:52.630378 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9472a1c-20f3-4a4c-bf28-17404317be46 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:52.630841 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9472a1c-20f3-4a4c-bf28-17404317be46 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:52.635002 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-0fae9d11-e156-45d6-bef5-8937328fd847 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for project cec39457db974eebbc0305cc555a64d4. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:32:52.639103 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-0fae9d11-e156-45d6-bef5-8937328fd847 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for user 4d41a6703cec435dbb7e687aa0088d05 and project cec39457db974eebbc0305cc555a64d4. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:32:52.762698 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0fae9d11-e156-45d6-bef5-8937328fd847 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.286968 Jul 12 18:32:52.763295 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 402/759] 10.222.0.47 () {60 vars in 1158 bytes} [Tue Jul 12 18:32:52 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:32:53.513951 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f9472a1c-20f3-4a4c-bf28-17404317be46 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "POST /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902812 Jul 12 18:32:53.514657 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 358/760] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:32:52 2022] POST /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051/os-volume_attachments => generated 194 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:32:55.305510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-616622257", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "363a49e9-fc6d-4564-a5c2-668089b41523"}], "security_groups": [{"name": "tempest-securitygroup--1938985956"}], "key_name": "tempest-keypair-82334", "user_data": "}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:32:55.425248 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] validate_networks() for [('363a49e9-fc6d-4564-a5c2-668089b41523', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:32:55.835178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:32:55.837968 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:32:55.837968 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:32:55.837968 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:32:55.837968 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:32:55.846634 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:55.847620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:55.848486 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:55.848959 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:55.869371 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for project cec39457db974eebbc0305cc555a64d4. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:32:55.873822 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for user 4d41a6703cec435dbb7e687aa0088d05 and project cec39457db974eebbc0305cc555a64d4. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:32:55.887487 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:32:55.890202 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:32:56.012248 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8c19e4cc-8fb1-49ba-9261-59d6fc931238 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.713828 Jul 12 18:32:56.013288 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 403/761] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:32:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:32:56.024564 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-57c16986-c2fd-48a2-9d2b-d564d0114e34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:56.025430 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-57c16986-c2fd-48a2-9d2b-d564d0114e34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:56.088913 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-57c16986-c2fd-48a2-9d2b-d564d0114e34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:56.097613 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-57c16986-c2fd-48a2-9d2b-d564d0114e34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1236 microversion: 2.1 time: 0.077771 Jul 12 18:32:56.098247 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 359/762] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:56 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:57.115061 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bf7e4cbe-a23a-4c98-a1c2-b09e0ba2911e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:57.115880 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-bf7e4cbe-a23a-4c98-a1c2-b09e0ba2911e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:57.172238 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-bf7e4cbe-a23a-4c98-a1c2-b09e0ba2911e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:57.179788 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bf7e4cbe-a23a-4c98-a1c2-b09e0ba2911e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1236 microversion: 2.1 time: 0.068815 Jul 12 18:32:57.180806 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 404/763] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:57 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:58.196218 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-75819189-9f5b-42a1-9c1b-505eef0c1565 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:58.196889 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-75819189-9f5b-42a1-9c1b-505eef0c1565 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:58.204146 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75819189-9f5b-42a1-9c1b-505eef0c1565 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:58.204745 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75819189-9f5b-42a1-9c1b-505eef0c1565 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:58.205498 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75819189-9f5b-42a1-9c1b-505eef0c1565 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:58.205923 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75819189-9f5b-42a1-9c1b-505eef0c1565 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:58.280438 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-75819189-9f5b-42a1-9c1b-505eef0c1565 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:58.288893 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-75819189-9f5b-42a1-9c1b-505eef0c1565 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1288 microversion: 2.1 time: 0.096497 Jul 12 18:32:58.289482 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 360/764] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:58 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:32:59.306906 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c2611230-a8ca-4634-a89f-3b8074dcb574 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:32:59.307517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c2611230-a8ca-4634-a89f-3b8074dcb574 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:32:59.314178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c2611230-a8ca-4634-a89f-3b8074dcb574 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:59.314630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c2611230-a8ca-4634-a89f-3b8074dcb574 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:59.315419 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c2611230-a8ca-4634-a89f-3b8074dcb574 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:32:59.315909 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c2611230-a8ca-4634-a89f-3b8074dcb574 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:32:59.379096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c2611230-a8ca-4634-a89f-3b8074dcb574 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:32:59.386781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c2611230-a8ca-4634-a89f-3b8074dcb574 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1294 microversion: 2.1 time: 0.083753 Jul 12 18:32:59.387386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 405/765] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:32:59 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:00.406440 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-69979f21-69f6-4059-937f-599719919561 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:00.407109 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-69979f21-69f6-4059-937f-599719919561 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:00.420016 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-69979f21-69f6-4059-937f-599719919561 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:00.424338 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-69979f21-69f6-4059-937f-599719919561 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:00.425578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-69979f21-69f6-4059-937f-599719919561 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:00.426024 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-69979f21-69f6-4059-937f-599719919561 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:00.649104 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-6af82bb0-a673-478c-842e-0a144dc15cfd req-b7fda649-ff29-4013-be7a-9e82d01a20fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccee0a08-5b3a-4857-a132-58abc74ebdb7", "tag": "f7c7a214-b79d-4e3e-9a63-c3217155820e"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:00.666694 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-6af82bb0-a673-478c-842e-0a144dc15cfd req-b7fda649-ff29-4013-be7a-9e82d01a20fa service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:00.667181 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-6af82bb0-a673-478c-842e-0a144dc15cfd req-b7fda649-ff29-4013-be7a-9e82d01a20fa service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:00.679529 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-6af82bb0-a673-478c-842e-0a144dc15cfd req-b7fda649-ff29-4013-be7a-9e82d01a20fa service nova] Creating event network-changed:f7c7a214-b79d-4e3e-9a63-c3217155820e for instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 on hv-cinder-84488 Jul 12 18:33:00.684906 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-6af82bb0-a673-478c-842e-0a144dc15cfd req-b7fda649-ff29-4013-be7a-9e82d01a20fa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039530 Jul 12 18:33:00.685647 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 406/766] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:33:00.760673 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-69979f21-69f6-4059-937f-599719919561 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:00.774907 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-69979f21-69f6-4059-937f-599719919561 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1362 microversion: 2.1 time: 0.374224 Jul 12 18:33:00.776400 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 361/767] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:00 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1362 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:01.794115 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fc613141-fbb9-4152-9363-c75d73a80306 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:01.794728 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fc613141-fbb9-4152-9363-c75d73a80306 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:01.812331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fc613141-fbb9-4152-9363-c75d73a80306 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:01.813040 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fc613141-fbb9-4152-9363-c75d73a80306 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:01.813988 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fc613141-fbb9-4152-9363-c75d73a80306 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:01.814579 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fc613141-fbb9-4152-9363-c75d73a80306 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:01.992171 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fc613141-fbb9-4152-9363-c75d73a80306 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:02.011280 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fc613141-fbb9-4152-9363-c75d73a80306 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1362 microversion: 2.1 time: 0.220448 Jul 12 18:33:02.011544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 407/768] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:01 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:03.028609 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3edd09ce-4b75-48cd-a8c7-61f6e481fcfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:03.029503 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3edd09ce-4b75-48cd-a8c7-61f6e481fcfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:03.039851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3edd09ce-4b75-48cd-a8c7-61f6e481fcfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:03.039851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3edd09ce-4b75-48cd-a8c7-61f6e481fcfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:03.039851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3edd09ce-4b75-48cd-a8c7-61f6e481fcfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:03.039851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3edd09ce-4b75-48cd-a8c7-61f6e481fcfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:03.182009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3edd09ce-4b75-48cd-a8c7-61f6e481fcfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:03.190126 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3edd09ce-4b75-48cd-a8c7-61f6e481fcfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1362 microversion: 2.1 time: 0.165518 Jul 12 18:33:03.199958 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 362/769] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:03 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:04.212294 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ba85f78d-978e-47e7-ba70-9ca666a59903 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:04.213352 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ba85f78d-978e-47e7-ba70-9ca666a59903 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:04.220129 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba85f78d-978e-47e7-ba70-9ca666a59903 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:04.220772 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba85f78d-978e-47e7-ba70-9ca666a59903 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:04.221615 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba85f78d-978e-47e7-ba70-9ca666a59903 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:04.223560 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba85f78d-978e-47e7-ba70-9ca666a59903 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:04.501932 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ba85f78d-978e-47e7-ba70-9ca666a59903 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:04.510854 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ba85f78d-978e-47e7-ba70-9ca666a59903 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1362 microversion: 2.1 time: 0.305704 Jul 12 18:33:04.512153 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 408/770] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:04 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:05.528577 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b991fa4a-f3d0-4654-87f5-13e82f1eb3ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:05.529317 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b991fa4a-f3d0-4654-87f5-13e82f1eb3ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:05.536693 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b991fa4a-f3d0-4654-87f5-13e82f1eb3ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:05.537133 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b991fa4a-f3d0-4654-87f5-13e82f1eb3ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:05.537897 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b991fa4a-f3d0-4654-87f5-13e82f1eb3ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:05.538323 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b991fa4a-f3d0-4654-87f5-13e82f1eb3ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:05.677463 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b991fa4a-f3d0-4654-87f5-13e82f1eb3ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:05.684959 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b991fa4a-f3d0-4654-87f5-13e82f1eb3ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1362 microversion: 2.1 time: 0.160304 Jul 12 18:33:05.685521 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 363/771] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:05 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:06.701559 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fbbae7c5-7171-4508-a19f-1470ac26e8cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:06.702272 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fbbae7c5-7171-4508-a19f-1470ac26e8cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:06.704776 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:06.710307 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbbae7c5-7171-4508-a19f-1470ac26e8cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:06.710757 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbbae7c5-7171-4508-a19f-1470ac26e8cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:06.713344 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbbae7c5-7171-4508-a19f-1470ac26e8cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:06.713344 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbbae7c5-7171-4508-a19f-1470ac26e8cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:06.860784 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fbbae7c5-7171-4508-a19f-1470ac26e8cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:06.877338 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fbbae7c5-7171-4508-a19f-1470ac26e8cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1362 microversion: 2.1 time: 0.179586 Jul 12 18:33:06.877925 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 409/772] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:06 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:07.905310 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7e4b0f8a-7e93-43f4-9f7b-9dfdc16ed219 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:07.908135 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7e4b0f8a-7e93-43f4-9f7b-9dfdc16ed219 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:07.933805 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:07.936683 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7e4b0f8a-7e93-43f4-9f7b-9dfdc16ed219 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:07.947373 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7e4b0f8a-7e93-43f4-9f7b-9dfdc16ed219 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:07.956227 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7e4b0f8a-7e93-43f4-9f7b-9dfdc16ed219 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:07.956227 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7e4b0f8a-7e93-43f4-9f7b-9dfdc16ed219 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:08.167624 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7e4b0f8a-7e93-43f4-9f7b-9dfdc16ed219 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:08.179106 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7e4b0f8a-7e93-43f4-9f7b-9dfdc16ed219 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1362 microversion: 2.1 time: 0.286494 Jul 12 18:33:08.180241 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 364/773] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:07 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:08.342010 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-23803f4d-07ad-4da1-b560-513551ab0d32 req-9df17fb9-eb38-4ad4-bb90-1d08fec6e36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccee0a08-5b3a-4857-a132-58abc74ebdb7", "name": "network-vif-plugged", "status": "completed", "tag": "f7c7a214-b79d-4e3e-9a63-c3217155820e"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:08.350295 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=12 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:08.360395 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-23803f4d-07ad-4da1-b560-513551ab0d32 req-9df17fb9-eb38-4ad4-bb90-1d08fec6e36a service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:08.361080 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-23803f4d-07ad-4da1-b560-513551ab0d32 req-9df17fb9-eb38-4ad4-bb90-1d08fec6e36a service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:08.378705 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-23803f4d-07ad-4da1-b560-513551ab0d32 req-9df17fb9-eb38-4ad4-bb90-1d08fec6e36a service nova] Creating event network-vif-plugged:f7c7a214-b79d-4e3e-9a63-c3217155820e for instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 on hv-cinder-84488 Jul 12 18:33:08.384768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-23803f4d-07ad-4da1-b560-513551ab0d32 req-9df17fb9-eb38-4ad4-bb90-1d08fec6e36a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048041 Jul 12 18:33:08.392655 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 410/774] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:33:09.197505 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d86f126d-31c0-4d1e-8757-88eba1fc0986 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:09.198775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d86f126d-31c0-4d1e-8757-88eba1fc0986 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:09.211678 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d86f126d-31c0-4d1e-8757-88eba1fc0986 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:09.211810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d86f126d-31c0-4d1e-8757-88eba1fc0986 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:09.212679 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d86f126d-31c0-4d1e-8757-88eba1fc0986 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:09.213024 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d86f126d-31c0-4d1e-8757-88eba1fc0986 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:09.385441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d86f126d-31c0-4d1e-8757-88eba1fc0986 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:09.394150 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d86f126d-31c0-4d1e-8757-88eba1fc0986 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1362 microversion: 2.1 time: 0.200256 Jul 12 18:33:09.404851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 365/775] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:09 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:10.416195 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-38834d8d-c99d-43fd-9143-4e69a6a460c2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:10.422712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-38834d8d-c99d-43fd-9143-4e69a6a460c2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:10.424569 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-38834d8d-c99d-43fd-9143-4e69a6a460c2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:10.425861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-38834d8d-c99d-43fd-9143-4e69a6a460c2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:10.426958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-38834d8d-c99d-43fd-9143-4e69a6a460c2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:10.427616 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-38834d8d-c99d-43fd-9143-4e69a6a460c2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:10.634607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-38834d8d-c99d-43fd-9143-4e69a6a460c2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:10.642486 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-38834d8d-c99d-43fd-9143-4e69a6a460c2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1362 microversion: 2.1 time: 0.232467 Jul 12 18:33:10.643306 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 411/776] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:10 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:11.661925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b5ad2461-4df7-4a87-81d7-9e783e7e365d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:11.663674 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b5ad2461-4df7-4a87-81d7-9e783e7e365d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:11.673441 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5ad2461-4df7-4a87-81d7-9e783e7e365d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:11.673887 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5ad2461-4df7-4a87-81d7-9e783e7e365d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:11.675220 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5ad2461-4df7-4a87-81d7-9e783e7e365d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:11.676574 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5ad2461-4df7-4a87-81d7-9e783e7e365d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:11.853930 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b5ad2461-4df7-4a87-81d7-9e783e7e365d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:11.866278 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b5ad2461-4df7-4a87-81d7-9e783e7e365d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1362 microversion: 2.1 time: 0.209697 Jul 12 18:33:11.867154 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 366/777] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:11 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:12.617471 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ec995fff-caa5-4e37-bda8-189b736386bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Action: 'create', calling method: .version_select at 0x7f1bb0a78670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1121766819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfedTo5JWMDFgklL9XXDr9o2xmHHmg64PLWyIyBVL/ncXQd+BsLJDJ3Qaq0lQts6SED77JiMi4ejl7UpuH5D523eqm3ybpuy36d8ealQ+qFqlB69446Zixo7dvCbOIA3w=="}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:12.632545 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-ec995fff-caa5-4e37-bda8-189b736386bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Getting quotas for project 447abd08211d49f9b503130ac5c380b7. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:33:12.637000 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-ec995fff-caa5-4e37-bda8-189b736386bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Getting quotas for user 7a647aab17cf4345800cd9072a7820c0 and project 447abd08211d49f9b503130ac5c380b7. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:33:12.745346 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ec995fff-caa5-4e37-bda8-189b736386bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.393607 Jul 12 18:33:12.745866 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 412/778] 10.222.0.47 () {60 vars in 1158 bytes} [Tue Jul 12 18:33:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:33:12.888491 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1a27dced-a3b0-4aa2-a426-3c9b93887787 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:12.889157 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1a27dced-a3b0-4aa2-a426-3c9b93887787 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:12.896628 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a27dced-a3b0-4aa2-a426-3c9b93887787 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:12.897134 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a27dced-a3b0-4aa2-a426-3c9b93887787 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:12.897930 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a27dced-a3b0-4aa2-a426-3c9b93887787 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:12.898359 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a27dced-a3b0-4aa2-a426-3c9b93887787 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:13.049563 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1a27dced-a3b0-4aa2-a426-3c9b93887787 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:13.058093 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1a27dced-a3b0-4aa2-a426-3c9b93887787 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1553 microversion: 2.1 time: 0.173449 Jul 12 18:33:13.059040 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 367/779] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:12 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:13.076520 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0ead8905-c003-41b1-9c9b-7385abf17d4a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:13.077085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0ead8905-c003-41b1-9c9b-7385abf17d4a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:13.086116 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ead8905-c003-41b1-9c9b-7385abf17d4a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:13.086582 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ead8905-c003-41b1-9c9b-7385abf17d4a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:13.087374 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ead8905-c003-41b1-9c9b-7385abf17d4a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:13.087839 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0ead8905-c003-41b1-9c9b-7385abf17d4a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:13.198494 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0ead8905-c003-41b1-9c9b-7385abf17d4a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126323 Jul 12 18:33:13.199095 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 413/780] 10.222.0.47 () {58 vars in 1274 bytes} [Tue Jul 12 18:33:13 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:33:14.352036 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-a063cdaf-2ed0-49f1-b06e-6b7e9aaef383 req-5478132c-9153-4f94-a16a-1a547d71b12a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccee0a08-5b3a-4857-a132-58abc74ebdb7", "tag": "f7c7a214-b79d-4e3e-9a63-c3217155820e"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:14.370515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-a063cdaf-2ed0-49f1-b06e-6b7e9aaef383 req-5478132c-9153-4f94-a16a-1a547d71b12a service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:14.370958 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-a063cdaf-2ed0-49f1-b06e-6b7e9aaef383 req-5478132c-9153-4f94-a16a-1a547d71b12a service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:14.383797 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-a063cdaf-2ed0-49f1-b06e-6b7e9aaef383 req-5478132c-9153-4f94-a16a-1a547d71b12a service nova] Creating event network-changed:f7c7a214-b79d-4e3e-9a63-c3217155820e for instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 on hv-cinder-84488 Jul 12 18:33:14.395249 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-a063cdaf-2ed0-49f1-b06e-6b7e9aaef383 req-5478132c-9153-4f94-a16a-1a547d71b12a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043168 Jul 12 18:33:14.395249 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 368/781] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:33:20.052124 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-dea7f411-9773-441c-85ff-46f7d31c1329 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:20.052696 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-dea7f411-9773-441c-85ff-46f7d31c1329 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:20.058974 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dea7f411-9773-441c-85ff-46f7d31c1329 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:20.059356 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dea7f411-9773-441c-85ff-46f7d31c1329 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:20.060111 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dea7f411-9773-441c-85ff-46f7d31c1329 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:20.060590 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-dea7f411-9773-441c-85ff-46f7d31c1329 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:20.142841 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-dea7f411-9773-441c-85ff-46f7d31c1329 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lazy-loading 'services' on Instance uuid 23209fec-1327-4d01-b7fc-289c81646051 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:33:20.389055 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-dea7f411-9773-441c-85ff-46f7d31c1329 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "DELETE /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051/os-volume_attachments/c06343a7-fa46-4916-9738-d6d8d52534bb" status: 202 len: 0 microversion: 2.1 time: 0.341226 Jul 12 18:33:20.389785 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 414/782] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:33:20 2022] DELETE /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051/os-volume_attachments/c06343a7-fa46-4916-9738-d6d8d52534bb => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:33:21.511514 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a213cdb1-60f2-46aa-893c-ec4ac123c972 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:21.512210 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a213cdb1-60f2-46aa-893c-ec4ac123c972 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:21.519167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a213cdb1-60f2-46aa-893c-ec4ac123c972 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:21.519671 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a213cdb1-60f2-46aa-893c-ec4ac123c972 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:21.520525 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a213cdb1-60f2-46aa-893c-ec4ac123c972 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:21.520982 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a213cdb1-60f2-46aa-893c-ec4ac123c972 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:21.548501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a213cdb1-60f2-46aa-893c-ec4ac123c972 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:33:21.892554 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a213cdb1-60f2-46aa-893c-ec4ac123c972 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "DELETE /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 204 len: 0 microversion: 2.1 time: 0.385000 Jul 12 18:33:21.893157 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 369/783] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:33:21 2022] DELETE /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:33:21.902295 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-653821ea-5eae-4b88-91b8-fa9315d6a0d1 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:21.902993 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-653821ea-5eae-4b88-91b8-fa9315d6a0d1 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:21.911467 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-653821ea-5eae-4b88-91b8-fa9315d6a0d1 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:21.911467 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-653821ea-5eae-4b88-91b8-fa9315d6a0d1 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:21.911467 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-653821ea-5eae-4b88-91b8-fa9315d6a0d1 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:21.911769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-653821ea-5eae-4b88-91b8-fa9315d6a0d1 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:22.055318 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-653821ea-5eae-4b88-91b8-fa9315d6a0d1 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:22.063364 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-653821ea-5eae-4b88-91b8-fa9315d6a0d1 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1514 microversion: 2.1 time: 0.165485 Jul 12 18:33:22.063730 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 415/784] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:21 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:23.080883 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6b4cce2d-babc-4720-9b1f-182756dac3e6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:23.081578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6b4cce2d-babc-4720-9b1f-182756dac3e6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:23.088181 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b4cce2d-babc-4720-9b1f-182756dac3e6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:23.088654 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b4cce2d-babc-4720-9b1f-182756dac3e6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:23.089502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b4cce2d-babc-4720-9b1f-182756dac3e6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:23.089857 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b4cce2d-babc-4720-9b1f-182756dac3e6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:23.092799 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:23.235973 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6b4cce2d-babc-4720-9b1f-182756dac3e6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:23.246157 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6b4cce2d-babc-4720-9b1f-182756dac3e6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1514 microversion: 2.1 time: 0.169395 Jul 12 18:33:23.246778 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 370/785] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:23 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:24.263425 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d5535610-97de-4afc-83e5-9f16774391a4 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:24.263997 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d5535610-97de-4afc-83e5-9f16774391a4 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:24.266052 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=4 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:24.266821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=5 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:24.272345 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d5535610-97de-4afc-83e5-9f16774391a4 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:24.272876 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d5535610-97de-4afc-83e5-9f16774391a4 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:24.273645 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d5535610-97de-4afc-83e5-9f16774391a4 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:24.274082 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d5535610-97de-4afc-83e5-9f16774391a4 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:24.409973 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d5535610-97de-4afc-83e5-9f16774391a4 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:24.418057 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d5535610-97de-4afc-83e5-9f16774391a4 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1514 microversion: 2.1 time: 0.158737 Jul 12 18:33:24.418718 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 416/786] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:24 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:24.488862 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-1e449a92-1221-42f2-a807-991200856c67 req-8b6c4063-8fdc-4803-b9b8-b99d8763d545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23209fec-1327-4d01-b7fc-289c81646051", "name": "network-vif-deleted", "tag": "10475ea0-db7e-489c-b80b-a48825afbaeb"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:24.492955 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:24.498099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-1e449a92-1221-42f2-a807-991200856c67 req-8b6c4063-8fdc-4803-b9b8-b99d8763d545 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:24.498528 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-1e449a92-1221-42f2-a807-991200856c67 req-8b6c4063-8fdc-4803-b9b8-b99d8763d545 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:24.510083 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-1e449a92-1221-42f2-a807-991200856c67 req-8b6c4063-8fdc-4803-b9b8-b99d8763d545 service nova] Creating event network-vif-deleted:10475ea0-db7e-489c-b80b-a48825afbaeb for instance 23209fec-1327-4d01-b7fc-289c81646051 on hv-cinder-84488 Jul 12 18:33:24.515038 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-1e449a92-1221-42f2-a807-991200856c67 req-8b6c4063-8fdc-4803-b9b8-b99d8763d545 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030354 Jul 12 18:33:24.515640 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 371/787] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:33:25.435851 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3a564654-6b96-43f9-9dd2-71b71e64b1aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:25.436464 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3a564654-6b96-43f9-9dd2-71b71e64b1aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:25.443481 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3a564654-6b96-43f9-9dd2-71b71e64b1aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:25.443926 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3a564654-6b96-43f9-9dd2-71b71e64b1aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:25.444713 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3a564654-6b96-43f9-9dd2-71b71e64b1aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:25.445192 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3a564654-6b96-43f9-9dd2-71b71e64b1aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:25.481305 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3a564654-6b96-43f9-9dd2-71b71e64b1aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:25.481746 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-3a564654-6b96-43f9-9dd2-71b71e64b1aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:25.482186 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-3a564654-6b96-43f9-9dd2-71b71e64b1aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lazy-loading 'fault' on Instance uuid 23209fec-1327-4d01-b7fc-289c81646051 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:33:25.527858 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3a564654-6b96-43f9-9dd2-71b71e64b1aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:25.535448 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3a564654-6b96-43f9-9dd2-71b71e64b1aa tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 200 len: 1309 microversion: 2.1 time: 0.103450 Jul 12 18:33:25.536000 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 417/788] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:25 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:26.555312 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-17f719c5-290b-4981-81ea-91113602c55a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:26.556045 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-17f719c5-290b-4981-81ea-91113602c55a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: 23209fec-1327-4d01-b7fc-289c81646051] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:26.563307 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-17f719c5-290b-4981-81ea-91113602c55a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:26.563748 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-17f719c5-290b-4981-81ea-91113602c55a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:26.565657 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-17f719c5-290b-4981-81ea-91113602c55a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:26.565657 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-17f719c5-290b-4981-81ea-91113602c55a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:26.579222 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-17f719c5-290b-4981-81ea-91113602c55a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] HTTP exception thrown: Instance 23209fec-1327-4d01-b7fc-289c81646051 could not be found. Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-17f719c5-290b-4981-81ea-91113602c55a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Request method failure captured: Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 HTTP/1.1 Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb4rhub59voKX1K2VvH2apd1aa7SIjeHoioDL7EvxoHv5brkBKvydAaWD3r6KX8rh0L3MCJ-wTgFKUcbzId4k4rYhQZAj2TfSwWFXiFqATbzaI1QQH9PsRcbQw41J1tFIE1j-Kf07nW_s1U2IGOZlPLX2oYxWrb7kTBXEDqTkkxqj8Y Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 246cc971eb1a4882868c39c39d27e3f5 Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesSnapshotTestJSON-383250509 Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:33:26.580928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/246cc971eb1a4882868c39c39d27e3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/246cc971eb1a4882868c39c39d27e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_246cc971eb1a4882868c39c39d27e3f5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/246cc971eb1a4882868c39c39d27e3f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesSnapshotTestJSON-383250509 Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 246cc971eb1a4882868c39c39d27e3f5 Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-383250509 Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesSnapshotTestJSON-383250509-project Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 38c44ad4254a46beba4a8a2ca5175f82 Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesSnapshotTestJSON-383250509-project Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 23209fec-1327-4d01-b7fc-289c81646051 could not be found. Jul 12 18:33:26.582757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '23209fec-1327-4d01-b7fc-289c81646051'} Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23209fec-1327-4d01-b7fc-289c81646051 could not be found. Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:33:26.583685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23209fec-1327-4d01-b7fc-289c81646051 could not be found. Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23209fec-1327-4d01-b7fc-289c81646051 could not be found. Jul 12 18:33:26.585234 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:33:26.586713 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-17f719c5-290b-4981-81ea-91113602c55a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Returning 404 to user: Instance 23209fec-1327-4d01-b7fc-289c81646051 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:33:26.586713 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-17f719c5-290b-4981-81ea-91113602c55a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051" status: 404 len: 111 microversion: 2.1 time: 0.032941 Jul 12 18:33:26.586713 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 372/789] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:26 2022] GET /compute/v2.1/servers/23209fec-1327-4d01-b7fc-289c81646051 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:33:37.166547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1481287263", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "networks": [{"uuid": "c61fcf91-5797-4951-9e2f-81d214fdaefa"}]}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:37.173991 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=5 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:37.174658 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:37.218883 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] validate_networks() for [('c61fcf91-5797-4951-9e2f-81d214fdaefa', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:33:37.580006 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:33:37.580447 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:33:37.580937 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:33:37.581399 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:33:37.582337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:33:37.591222 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:37.591665 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:37.592507 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:37.592965 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:37.610568 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Getting quotas for project 246cc971eb1a4882868c39c39d27e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:33:37.615179 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Getting quotas for user 38c44ad4254a46beba4a8a2ca5175f82 and project 246cc971eb1a4882868c39c39d27e3f5. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:33:37.626137 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:33:37.628420 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:33:37.768625 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-01127d7d-40dc-433d-8ffa-a1711cedfd20 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605897 Jul 12 18:33:37.769930 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 418/790] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:33:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:33:37.779630 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f84eacf0-8358-4ef7-8d5f-756effc75a31 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:37.780238 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f84eacf0-8358-4ef7-8d5f-756effc75a31 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:37.783083 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=9 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:37.808420 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1695452223", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1121766819", "security_groups": [{"name": "tempest-secgroup-smoke-93854513"}], "block_device_mapping_v2": [{"uuid": "eec23b48-1f45-466a-904a-60ee0c03041c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "337a86a6-f7ab-43ec-ae8f-46aa53a87569"}]}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:37.843295 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f84eacf0-8358-4ef7-8d5f-756effc75a31 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:37.853274 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f84eacf0-8358-4ef7-8d5f-756effc75a31 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1219 microversion: 2.1 time: 0.077376 Jul 12 18:33:37.860939 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 373/791] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:37 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:37.928800 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] validate_networks() for [('337a86a6-f7ab-43ec-ae8f-46aa53a87569', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:33:38.326110 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:33:38.326687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:33:38.327002 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:33:38.327398 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:33:38.327799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:33:38.337364 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:38.337888 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:38.338686 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:38.339117 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:38.356155 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Getting quotas for project 447abd08211d49f9b503130ac5c380b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:33:38.359975 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Getting quotas for user 7a647aab17cf4345800cd9072a7820c0 and project 447abd08211d49f9b503130ac5c380b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:33:38.417527 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:33:38.419492 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eec23b48-1f45-466a-904a-60ee0c03041c',volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:33:38.870593 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-be3053e0-6c13-46ef-851f-1c4b6f27cc7d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:38.871189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-be3053e0-6c13-46ef-851f-1c4b6f27cc7d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:38.877566 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be3053e0-6c13-46ef-851f-1c4b6f27cc7d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:38.877999 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be3053e0-6c13-46ef-851f-1c4b6f27cc7d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:38.878869 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be3053e0-6c13-46ef-851f-1c4b6f27cc7d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:38.879844 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be3053e0-6c13-46ef-851f-1c4b6f27cc7d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:38.946446 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-be3053e0-6c13-46ef-851f-1c4b6f27cc7d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:38.954080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-be3053e0-6c13-46ef-851f-1c4b6f27cc7d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1223 microversion: 2.1 time: 0.087946 Jul 12 18:33:38.954642 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 374/792] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:38 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:33:38.976397 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-51aa268a-bd1e-4e91-a321-e5a08561d8ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.171746 Jul 12 18:33:38.977310 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 419/793] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:33:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 18:33:38.987429 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5f8dbc37-e376-4b55-ad4b-8d3f267aac13 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:38.988263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5f8dbc37-e376-4b55-ad4b-8d3f267aac13 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:39.043040 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5f8dbc37-e376-4b55-ad4b-8d3f267aac13 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:39.050071 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5f8dbc37-e376-4b55-ad4b-8d3f267aac13 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1095 microversion: 2.1 time: 0.066632 Jul 12 18:33:39.050942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 375/794] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:38 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:39.971564 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6f5bc0db-4c0e-4b13-98b2-1fd0784c480a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:39.972172 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6f5bc0db-4c0e-4b13-98b2-1fd0784c480a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:39.979944 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6f5bc0db-4c0e-4b13-98b2-1fd0784c480a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:39.980416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6f5bc0db-4c0e-4b13-98b2-1fd0784c480a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:39.981284 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6f5bc0db-4c0e-4b13-98b2-1fd0784c480a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:39.981716 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6f5bc0db-4c0e-4b13-98b2-1fd0784c480a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:40.050957 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6f5bc0db-4c0e-4b13-98b2-1fd0784c480a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:40.058462 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6f5bc0db-4c0e-4b13-98b2-1fd0784c480a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1271 microversion: 2.1 time: 0.091213 Jul 12 18:33:40.059024 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 420/795] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:39 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:40.066948 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c9bbc606-1dea-47a2-95d8-e7410890aac7 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:40.067617 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c9bbc606-1dea-47a2-95d8-e7410890aac7 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:40.121583 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c9bbc606-1dea-47a2-95d8-e7410890aac7 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:40.128945 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c9bbc606-1dea-47a2-95d8-e7410890aac7 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1095 microversion: 2.1 time: 0.065915 Jul 12 18:33:40.130450 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 376/796] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:40 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:41.075657 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5134c2fa-22b0-4bb6-8121-f9581f806e45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:41.076232 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5134c2fa-22b0-4bb6-8121-f9581f806e45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:41.083799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5134c2fa-22b0-4bb6-8121-f9581f806e45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:41.084336 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5134c2fa-22b0-4bb6-8121-f9581f806e45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:41.085109 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5134c2fa-22b0-4bb6-8121-f9581f806e45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:41.086632 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5134c2fa-22b0-4bb6-8121-f9581f806e45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:41.148496 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cf33e44c-6270-4b9c-a720-7d883182c8dd tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:41.149297 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cf33e44c-6270-4b9c-a720-7d883182c8dd tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:41.155791 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cf33e44c-6270-4b9c-a720-7d883182c8dd tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:41.156337 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cf33e44c-6270-4b9c-a720-7d883182c8dd tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:41.157236 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cf33e44c-6270-4b9c-a720-7d883182c8dd tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:41.157712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cf33e44c-6270-4b9c-a720-7d883182c8dd tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:41.219286 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5134c2fa-22b0-4bb6-8121-f9581f806e45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:41.227164 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cf33e44c-6270-4b9c-a720-7d883182c8dd tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:41.227897 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5134c2fa-22b0-4bb6-8121-f9581f806e45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1319 microversion: 2.1 time: 0.155972 Jul 12 18:33:41.228723 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 421/797] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:41 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:41.237168 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cf33e44c-6270-4b9c-a720-7d883182c8dd tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1193 microversion: 2.1 time: 0.093108 Jul 12 18:33:41.238007 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 377/798] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:41 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:42.247192 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-054ef056-fa5d-4ca4-8849-c430df190c45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:42.250040 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-054ef056-fa5d-4ca4-8849-c430df190c45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:42.256497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bde83504-f9e1-4a2c-b858-aab1bf0d01bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:42.258975 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bde83504-f9e1-4a2c-b858-aab1bf0d01bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:42.259524 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-054ef056-fa5d-4ca4-8849-c430df190c45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:42.260054 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-054ef056-fa5d-4ca4-8849-c430df190c45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:42.260982 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-054ef056-fa5d-4ca4-8849-c430df190c45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:42.261524 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-054ef056-fa5d-4ca4-8849-c430df190c45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:42.268182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bde83504-f9e1-4a2c-b858-aab1bf0d01bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:42.270925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bde83504-f9e1-4a2c-b858-aab1bf0d01bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:42.270925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bde83504-f9e1-4a2c-b858-aab1bf0d01bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:42.270925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bde83504-f9e1-4a2c-b858-aab1bf0d01bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:42.463157 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-054ef056-fa5d-4ca4-8849-c430df190c45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:42.471435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-054ef056-fa5d-4ca4-8849-c430df190c45 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1319 microversion: 2.1 time: 0.228107 Jul 12 18:33:42.472657 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 422/799] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:42 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:42.477933 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-5ab5592e-eafa-4023-bdc9-3b17f539206e req-3f2b430d-72de-4358-a419-d9f830a547cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "becf4d4f-6b4d-4815-aad2-7a94716836bd", "tag": "2ea2c977-7f64-4fc3-9e1d-15585961b702"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:42.486601 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-5ab5592e-eafa-4023-bdc9-3b17f539206e req-3f2b430d-72de-4358-a419-d9f830a547cc service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:42.486982 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-5ab5592e-eafa-4023-bdc9-3b17f539206e req-3f2b430d-72de-4358-a419-d9f830a547cc service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:42.501172 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-5ab5592e-eafa-4023-bdc9-3b17f539206e req-3f2b430d-72de-4358-a419-d9f830a547cc service nova] Creating event network-changed:2ea2c977-7f64-4fc3-9e1d-15585961b702 for instance becf4d4f-6b4d-4815-aad2-7a94716836bd on hv-cinder-84488 Jul 12 18:33:42.508300 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-5ab5592e-eafa-4023-bdc9-3b17f539206e req-3f2b430d-72de-4358-a419-d9f830a547cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033492 Jul 12 18:33:42.509160 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 423/800] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:33:42.534604 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bde83504-f9e1-4a2c-b858-aab1bf0d01bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:42.546853 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bde83504-f9e1-4a2c-b858-aab1bf0d01bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1277 microversion: 2.1 time: 0.295159 Jul 12 18:33:42.549190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 378/801] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:42 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1277 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:43.343616 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-f805ddc2-c7b9-4d7f-938b-2acf32269f8c req-27a59dd8-b203-4dc5-a41a-f209bca50f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2", "tag": "7b905735-73a2-4639-ba81-f50913467d0a"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:43.353205 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-f805ddc2-c7b9-4d7f-938b-2acf32269f8c req-27a59dd8-b203-4dc5-a41a-f209bca50f38 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:43.359078 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-f805ddc2-c7b9-4d7f-938b-2acf32269f8c req-27a59dd8-b203-4dc5-a41a-f209bca50f38 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:43.374678 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-f805ddc2-c7b9-4d7f-938b-2acf32269f8c req-27a59dd8-b203-4dc5-a41a-f209bca50f38 service nova] Creating event network-changed:7b905735-73a2-4639-ba81-f50913467d0a for instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 on hv-cinder-84488 Jul 12 18:33:43.380437 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-f805ddc2-c7b9-4d7f-938b-2acf32269f8c req-27a59dd8-b203-4dc5-a41a-f209bca50f38 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040912 Jul 12 18:33:43.381317 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 424/802] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:33:43.489250 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e4a4d8a5-5921-412e-ace9-0c7c57527b01 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:43.489892 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e4a4d8a5-5921-412e-ace9-0c7c57527b01 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:43.496973 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e4a4d8a5-5921-412e-ace9-0c7c57527b01 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:43.497435 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e4a4d8a5-5921-412e-ace9-0c7c57527b01 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:43.498242 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e4a4d8a5-5921-412e-ace9-0c7c57527b01 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:43.498676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e4a4d8a5-5921-412e-ace9-0c7c57527b01 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:43.565141 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-63d012e5-6686-49b3-8575-68422930b6d2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:43.565841 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-63d012e5-6686-49b3-8575-68422930b6d2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:43.572244 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-63d012e5-6686-49b3-8575-68422930b6d2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:43.572725 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-63d012e5-6686-49b3-8575-68422930b6d2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:43.573579 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-63d012e5-6686-49b3-8575-68422930b6d2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:43.574012 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-63d012e5-6686-49b3-8575-68422930b6d2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:43.635249 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e4a4d8a5-5921-412e-ace9-0c7c57527b01 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:43.642857 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e4a4d8a5-5921-412e-ace9-0c7c57527b01 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1319 microversion: 2.1 time: 0.157734 Jul 12 18:33:43.643421 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 379/803] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:43 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:43.714077 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-63d012e5-6686-49b3-8575-68422930b6d2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:43.723922 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-63d012e5-6686-49b3-8575-68422930b6d2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1265 microversion: 2.1 time: 0.162395 Jul 12 18:33:43.724521 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 425/804] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:43 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:33:44.661137 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ee57017b-ba4f-4cb2-b70b-9d03b3f91b18 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:44.662015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ee57017b-ba4f-4cb2-b70b-9d03b3f91b18 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:44.668851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ee57017b-ba4f-4cb2-b70b-9d03b3f91b18 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:44.669286 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ee57017b-ba4f-4cb2-b70b-9d03b3f91b18 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:44.670042 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ee57017b-ba4f-4cb2-b70b-9d03b3f91b18 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:44.670464 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ee57017b-ba4f-4cb2-b70b-9d03b3f91b18 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:44.741868 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5242cc0c-16ae-46ab-9a07-619e78474481 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:44.742723 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5242cc0c-16ae-46ab-9a07-619e78474481 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:44.749188 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5242cc0c-16ae-46ab-9a07-619e78474481 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:44.749630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5242cc0c-16ae-46ab-9a07-619e78474481 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:44.750389 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5242cc0c-16ae-46ab-9a07-619e78474481 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:44.750820 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5242cc0c-16ae-46ab-9a07-619e78474481 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:44.810999 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ee57017b-ba4f-4cb2-b70b-9d03b3f91b18 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:44.819040 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ee57017b-ba4f-4cb2-b70b-9d03b3f91b18 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1319 microversion: 2.1 time: 0.162241 Jul 12 18:33:44.819624 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 380/805] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:44 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:44.886985 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5242cc0c-16ae-46ab-9a07-619e78474481 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:44.894470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5242cc0c-16ae-46ab-9a07-619e78474481 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1265 microversion: 2.1 time: 0.157146 Jul 12 18:33:44.895032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 426/806] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:44 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:33:45.836257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d6ef07bf-eed0-405e-8cff-299f7f541c9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:45.836891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d6ef07bf-eed0-405e-8cff-299f7f541c9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:45.843561 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d6ef07bf-eed0-405e-8cff-299f7f541c9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:45.844084 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d6ef07bf-eed0-405e-8cff-299f7f541c9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:45.844801 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d6ef07bf-eed0-405e-8cff-299f7f541c9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:45.845229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d6ef07bf-eed0-405e-8cff-299f7f541c9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:45.917119 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-03eb1eb9-d56b-4239-b813-bab7161ae885 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:45.917921 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-03eb1eb9-d56b-4239-b813-bab7161ae885 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:45.925163 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-03eb1eb9-d56b-4239-b813-bab7161ae885 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:45.925617 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-03eb1eb9-d56b-4239-b813-bab7161ae885 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:45.926390 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-03eb1eb9-d56b-4239-b813-bab7161ae885 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:45.927339 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-03eb1eb9-d56b-4239-b813-bab7161ae885 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:45.986532 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d6ef07bf-eed0-405e-8cff-299f7f541c9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:45.997506 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d6ef07bf-eed0-405e-8cff-299f7f541c9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1319 microversion: 2.1 time: 0.165209 Jul 12 18:33:45.998167 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 381/807] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:45 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:46.070957 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-03eb1eb9-d56b-4239-b813-bab7161ae885 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:46.078421 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-03eb1eb9-d56b-4239-b813-bab7161ae885 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1265 microversion: 2.1 time: 0.165432 Jul 12 18:33:46.078988 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 427/808] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:45 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:33:47.014687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d18ab629-43c9-4e58-a30a-7542d0ef923b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:47.015279 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d18ab629-43c9-4e58-a30a-7542d0ef923b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:47.021886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d18ab629-43c9-4e58-a30a-7542d0ef923b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:47.022327 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d18ab629-43c9-4e58-a30a-7542d0ef923b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:47.023088 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d18ab629-43c9-4e58-a30a-7542d0ef923b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:47.023516 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d18ab629-43c9-4e58-a30a-7542d0ef923b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:47.095639 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-df94bf5f-d2fb-4f12-828b-3a0f3c2557eb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:47.096349 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-df94bf5f-d2fb-4f12-828b-3a0f3c2557eb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:47.104171 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-df94bf5f-d2fb-4f12-828b-3a0f3c2557eb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:47.104685 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-df94bf5f-d2fb-4f12-828b-3a0f3c2557eb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:47.105466 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-df94bf5f-d2fb-4f12-828b-3a0f3c2557eb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:47.105904 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-df94bf5f-d2fb-4f12-828b-3a0f3c2557eb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:47.155264 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d18ab629-43c9-4e58-a30a-7542d0ef923b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:47.163651 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d18ab629-43c9-4e58-a30a-7542d0ef923b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1319 microversion: 2.1 time: 0.152862 Jul 12 18:33:47.166508 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 382/809] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:47 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:47.243261 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-df94bf5f-d2fb-4f12-828b-3a0f3c2557eb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:47.250646 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-df94bf5f-d2fb-4f12-828b-3a0f3c2557eb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1265 microversion: 2.1 time: 0.158938 Jul 12 18:33:47.251203 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 428/810] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:47 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:33:47.571242 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-2df84987-6446-4cd7-9244-f9e47bb6fdf0 req-25cf7630-3650-442c-a215-898afc9a5978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "becf4d4f-6b4d-4815-aad2-7a94716836bd", "name": "network-vif-plugged", "status": "completed", "tag": "2ea2c977-7f64-4fc3-9e1d-15585961b702"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:47.579863 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-2df84987-6446-4cd7-9244-f9e47bb6fdf0 req-25cf7630-3650-442c-a215-898afc9a5978 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:47.580299 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-2df84987-6446-4cd7-9244-f9e47bb6fdf0 req-25cf7630-3650-442c-a215-898afc9a5978 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:47.591808 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-2df84987-6446-4cd7-9244-f9e47bb6fdf0 req-25cf7630-3650-442c-a215-898afc9a5978 service nova] Creating event network-vif-plugged:2ea2c977-7f64-4fc3-9e1d-15585961b702 for instance becf4d4f-6b4d-4815-aad2-7a94716836bd on hv-cinder-84488 Jul 12 18:33:47.596993 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-2df84987-6446-4cd7-9244-f9e47bb6fdf0 req-25cf7630-3650-442c-a215-898afc9a5978 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030160 Jul 12 18:33:47.597629 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 383/811] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:33:48.181433 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-72413217-fa4c-41f9-a519-c9f5111b8a9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:48.182045 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-72413217-fa4c-41f9-a519-c9f5111b8a9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:48.188631 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-72413217-fa4c-41f9-a519-c9f5111b8a9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:48.189086 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-72413217-fa4c-41f9-a519-c9f5111b8a9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:48.189861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-72413217-fa4c-41f9-a519-c9f5111b8a9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:48.190295 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-72413217-fa4c-41f9-a519-c9f5111b8a9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:48.268779 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-80d4cdce-c8cb-49b4-99b2-70290f85735b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:48.269396 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-80d4cdce-c8cb-49b4-99b2-70290f85735b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:48.276161 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80d4cdce-c8cb-49b4-99b2-70290f85735b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:48.276640 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80d4cdce-c8cb-49b4-99b2-70290f85735b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:48.277406 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80d4cdce-c8cb-49b4-99b2-70290f85735b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:48.278069 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80d4cdce-c8cb-49b4-99b2-70290f85735b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:48.325645 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-72413217-fa4c-41f9-a519-c9f5111b8a9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:48.333196 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-72413217-fa4c-41f9-a519-c9f5111b8a9b tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1319 microversion: 2.1 time: 0.155709 Jul 12 18:33:48.333774 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 429/812] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:48 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:48.415706 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-80d4cdce-c8cb-49b4-99b2-70290f85735b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:48.423123 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-80d4cdce-c8cb-49b4-99b2-70290f85735b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1265 microversion: 2.1 time: 0.159210 Jul 12 18:33:48.423685 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 384/813] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:48 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:33:49.349570 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-82a0d729-57f3-44ac-a635-7f08df5c8452 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:49.350356 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-82a0d729-57f3-44ac-a635-7f08df5c8452 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:49.352274 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=4 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:49.353217 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=12 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:49.358598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-82a0d729-57f3-44ac-a635-7f08df5c8452 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:49.359041 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-82a0d729-57f3-44ac-a635-7f08df5c8452 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:49.359799 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-82a0d729-57f3-44ac-a635-7f08df5c8452 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:49.360223 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-82a0d729-57f3-44ac-a635-7f08df5c8452 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:49.440462 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cd4acd8b-14c8-4085-9980-d81eb0d936be tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:49.441085 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cd4acd8b-14c8-4085-9980-d81eb0d936be tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:49.449109 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd4acd8b-14c8-4085-9980-d81eb0d936be tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:49.449550 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd4acd8b-14c8-4085-9980-d81eb0d936be tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:49.450576 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd4acd8b-14c8-4085-9980-d81eb0d936be tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:49.451755 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd4acd8b-14c8-4085-9980-d81eb0d936be tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:49.494304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-82a0d729-57f3-44ac-a635-7f08df5c8452 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:49.502152 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-82a0d729-57f3-44ac-a635-7f08df5c8452 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1508 microversion: 2.1 time: 0.156524 Jul 12 18:33:49.502724 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 430/814] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:49 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:49.520230 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-55b22eaa-3530-4072-b618-3b57648d9e57 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fac22d3-1449-4f25-ae9c-fb768f45a049", "device": "/dev/sdb"}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:49.522174 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-55b22eaa-3530-4072-b618-3b57648d9e57 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:49.529068 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-55b22eaa-3530-4072-b618-3b57648d9e57 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:49.529547 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-55b22eaa-3530-4072-b618-3b57648d9e57 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:49.530379 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-55b22eaa-3530-4072-b618-3b57648d9e57 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:49.530816 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-55b22eaa-3530-4072-b618-3b57648d9e57 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:49.594679 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cd4acd8b-14c8-4085-9980-d81eb0d936be tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:49.602675 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cd4acd8b-14c8-4085-9980-d81eb0d936be tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1265 microversion: 2.1 time: 0.166049 Jul 12 18:33:49.603501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 385/815] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:49 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:33:50.399575 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-55b22eaa-3530-4072-b618-3b57648d9e57 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "POST /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.883714 Jul 12 18:33:50.400183 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 431/816] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:33:49 2022] POST /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd/os-volume_attachments => generated 194 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:33:50.619879 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a95e752d-7e4f-4e65-9c1c-a8fb49e36d72 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:50.620656 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a95e752d-7e4f-4e65-9c1c-a8fb49e36d72 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:50.622517 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:50.627991 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a95e752d-7e4f-4e65-9c1c-a8fb49e36d72 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:50.628488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a95e752d-7e4f-4e65-9c1c-a8fb49e36d72 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:50.629257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a95e752d-7e4f-4e65-9c1c-a8fb49e36d72 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:50.629690 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a95e752d-7e4f-4e65-9c1c-a8fb49e36d72 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:50.768723 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a95e752d-7e4f-4e65-9c1c-a8fb49e36d72 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:50.777297 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a95e752d-7e4f-4e65-9c1c-a8fb49e36d72 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1265 microversion: 2.1 time: 0.162162 Jul 12 18:33:50.777876 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 386/817] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:50 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:51.070821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bee16c0d-2381-4416-880d-13a37c3592e2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:51.071388 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-bee16c0d-2381-4416-880d-13a37c3592e2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:51.077666 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bee16c0d-2381-4416-880d-13a37c3592e2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:51.078109 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bee16c0d-2381-4416-880d-13a37c3592e2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:51.079005 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bee16c0d-2381-4416-880d-13a37c3592e2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:51.079440 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bee16c0d-2381-4416-880d-13a37c3592e2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:51.103346 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bee16c0d-2381-4416-880d-13a37c3592e2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/ips" status: 200 len: 151 microversion: 2.1 time: 0.037961 Jul 12 18:33:51.103991 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 432/818] 10.222.0.47 () {58 vars in 1247 bytes} [Tue Jul 12 18:33:51 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:33:51.794141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0fd831f9-1c86-4768-b2cf-322c691b7db4 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:51.799107 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0fd831f9-1c86-4768-b2cf-322c691b7db4 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:51.801836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fd831f9-1c86-4768-b2cf-322c691b7db4 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:51.802310 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fd831f9-1c86-4768-b2cf-322c691b7db4 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:51.803050 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fd831f9-1c86-4768-b2cf-322c691b7db4 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:51.803479 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fd831f9-1c86-4768-b2cf-322c691b7db4 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:51.954432 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0fd831f9-1c86-4768-b2cf-322c691b7db4 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:51.962829 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0fd831f9-1c86-4768-b2cf-322c691b7db4 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1265 microversion: 2.1 time: 0.172741 Jul 12 18:33:51.963400 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 387/819] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:51 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:52.889257 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9eef8fd5-c539-4791-8786-d98b73206b5a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e45c01b2-04ee-43a3-a5cb-bd9bdbc355db"}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:52.889813 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9eef8fd5-c539-4791-8786-d98b73206b5a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:52.896445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9eef8fd5-c539-4791-8786-d98b73206b5a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:52.896861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9eef8fd5-c539-4791-8786-d98b73206b5a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:52.897674 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9eef8fd5-c539-4791-8786-d98b73206b5a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:52.898101 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9eef8fd5-c539-4791-8786-d98b73206b5a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:52.980076 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c9d9d779-a22a-42e8-a738-c0e54d0e98a1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:52.980714 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c9d9d779-a22a-42e8-a738-c0e54d0e98a1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:52.987492 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c9d9d779-a22a-42e8-a738-c0e54d0e98a1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:52.987930 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c9d9d779-a22a-42e8-a738-c0e54d0e98a1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:52.988724 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c9d9d779-a22a-42e8-a738-c0e54d0e98a1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:52.989153 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c9d9d779-a22a-42e8-a738-c0e54d0e98a1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:53.147083 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c9d9d779-a22a-42e8-a738-c0e54d0e98a1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:53.154679 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c9d9d779-a22a-42e8-a738-c0e54d0e98a1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1265 microversion: 2.1 time: 0.178819 Jul 12 18:33:53.155250 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 388/820] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:52 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:33:53.644598 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-cea79c3a-9dac-49ca-b934-9ff6f883d0b9 req-16faeb37-dd44-4599-ad9c-0741149edb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2", "name": "network-vif-plugged", "status": "completed", "tag": "7b905735-73a2-4639-ba81-f50913467d0a"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:53.655144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-cea79c3a-9dac-49ca-b934-9ff6f883d0b9 req-16faeb37-dd44-4599-ad9c-0741149edb6c service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:53.655144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-cea79c3a-9dac-49ca-b934-9ff6f883d0b9 req-16faeb37-dd44-4599-ad9c-0741149edb6c service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:53.666886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-cea79c3a-9dac-49ca-b934-9ff6f883d0b9 req-16faeb37-dd44-4599-ad9c-0741149edb6c service nova] Creating event network-vif-plugged:7b905735-73a2-4639-ba81-f50913467d0a for instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 on hv-cinder-84488 Jul 12 18:33:53.672162 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-cea79c3a-9dac-49ca-b934-9ff6f883d0b9 req-16faeb37-dd44-4599-ad9c-0741149edb6c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031456 Jul 12 18:33:53.672989 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 389/821] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:33:53.680170 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9eef8fd5-c539-4791-8786-d98b73206b5a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.795595 Jul 12 18:33:53.684573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 433/822] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:33:52 2022] POST /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:33:54.173297 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-985070bc-a656-4231-83d6-1f86c0aa60e2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:54.173989 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-985070bc-a656-4231-83d6-1f86c0aa60e2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:54.181034 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-985070bc-a656-4231-83d6-1f86c0aa60e2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:54.181475 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-985070bc-a656-4231-83d6-1f86c0aa60e2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:54.182229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-985070bc-a656-4231-83d6-1f86c0aa60e2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:54.182658 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-985070bc-a656-4231-83d6-1f86c0aa60e2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:54.320560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-985070bc-a656-4231-83d6-1f86c0aa60e2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:54.328031 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-985070bc-a656-4231-83d6-1f86c0aa60e2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1265 microversion: 2.1 time: 0.159477 Jul 12 18:33:54.328644 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 390/823] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:54 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:55.345924 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-53f9122c-b193-4fd2-9c1b-21465aa7c761 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:55.346622 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-53f9122c-b193-4fd2-9c1b-21465aa7c761 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:55.352861 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53f9122c-b193-4fd2-9c1b-21465aa7c761 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:55.353308 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53f9122c-b193-4fd2-9c1b-21465aa7c761 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:55.354067 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53f9122c-b193-4fd2-9c1b-21465aa7c761 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:55.354497 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-53f9122c-b193-4fd2-9c1b-21465aa7c761 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:55.488191 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-53f9122c-b193-4fd2-9c1b-21465aa7c761 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:55.492298 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:33:55.496958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-53f9122c-b193-4fd2-9c1b-21465aa7c761 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1452 microversion: 2.1 time: 0.155783 Jul 12 18:33:55.497528 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 434/824] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:55 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:55.513780 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cd6f6a8c-1748-4892-8690-e75faa93c69a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:33:55.514393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cd6f6a8c-1748-4892-8690-e75faa93c69a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:33:55.520966 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd6f6a8c-1748-4892-8690-e75faa93c69a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:55.521505 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd6f6a8c-1748-4892-8690-e75faa93c69a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:55.522262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd6f6a8c-1748-4892-8690-e75faa93c69a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:55.522689 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd6f6a8c-1748-4892-8690-e75faa93c69a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:55.658046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cd6f6a8c-1748-4892-8690-e75faa93c69a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:33:55.665937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cd6f6a8c-1748-4892-8690-e75faa93c69a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1452 microversion: 2.1 time: 0.155984 Jul 12 18:33:55.666536 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 391/825] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:33:55 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:33:57.957616 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-6520f886-2d3f-4a73-9658-91cc01e6fc94 req-faf67c26-ec6b-42d0-abc8-a2ef1b4c0964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2", "tag": "7b905735-73a2-4639-ba81-f50913467d0a"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:33:57.976659 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-6520f886-2d3f-4a73-9658-91cc01e6fc94 req-faf67c26-ec6b-42d0-abc8-a2ef1b4c0964 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:33:57.977386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-6520f886-2d3f-4a73-9658-91cc01e6fc94 req-faf67c26-ec6b-42d0-abc8-a2ef1b4c0964 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:33:57.989478 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-6520f886-2d3f-4a73-9658-91cc01e6fc94 req-faf67c26-ec6b-42d0-abc8-a2ef1b4c0964 service nova] Creating event network-changed:7b905735-73a2-4639-ba81-f50913467d0a for instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 on hv-cinder-84488 Jul 12 18:33:57.995765 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-6520f886-2d3f-4a73-9658-91cc01e6fc94 req-faf67c26-ec6b-42d0-abc8-a2ef1b4c0964 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041978 Jul 12 18:33:57.996959 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 435/826] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:34:07.537275 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a3bd1f33-93b3-4682-a8bf-de0c44d12baf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: .version_select at 0x7f1bb08999d0>, body: {"keypair": {"name": "tempest-keypair-958473933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBZPGxkx9cw9caqHJ+Ha8Lu0ML6kunLYPOIsfJj6MN5uXsbjIp7A/rTYpdr3Crxg7d+jQaOeHweh5BX2Ds9QHcYNUEe/ltk46Z+7AaDHo/53BfapG+UVVQdpPpiW6myOQ=="}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:34:07.541940 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=47 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:07.542609 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=88 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:07.553340 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-a3bd1f33-93b3-4682-a8bf-de0c44d12baf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for project cec39457db974eebbc0305cc555a64d4. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:34:07.558130 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-a3bd1f33-93b3-4682-a8bf-de0c44d12baf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for user 4d41a6703cec435dbb7e687aa0088d05 and project cec39457db974eebbc0305cc555a64d4. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:34:07.683529 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a3bd1f33-93b3-4682-a8bf-de0c44d12baf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151133 Jul 12 18:34:07.684148 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 392/827] 10.222.0.47 () {60 vars in 1158 bytes} [Tue Jul 12 18:34:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:34:10.136551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:10.141177 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1995025638", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "363a49e9-fc6d-4564-a5c2-668089b41523"}], "security_groups": [{"name": "tempest-securitygroup--1884283275"}], "key_name": "tempest-keypair-958473933", "user_data": "}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:34:10.244249 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] validate_networks() for [('363a49e9-fc6d-4564-a5c2-668089b41523', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:34:10.618870 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:34:10.619286 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:34:10.619755 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:34:10.620162 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:34:10.620604 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:34:10.629667 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:10.632813 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:10.632813 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:10.632813 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:10.649002 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for project cec39457db974eebbc0305cc555a64d4. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:34:10.653212 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for user 4d41a6703cec435dbb7e687aa0088d05 and project cec39457db974eebbc0305cc555a64d4. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:34:10.664386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:34:10.666849 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:34:10.830999 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c3c81830-6616-4649-b74c-5410780f4879 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.695927 Jul 12 18:34:10.831674 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 436/828] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:34:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:34:10.842770 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f3ab320d-e83a-4840-834e-ad6ce772cc82 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:10.844229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f3ab320d-e83a-4840-834e-ad6ce772cc82 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:10.905075 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f3ab320d-e83a-4840-834e-ad6ce772cc82 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:10.912287 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f3ab320d-e83a-4840-834e-ad6ce772cc82 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1241 microversion: 2.1 time: 0.074054 Jul 12 18:34:10.912953 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 393/829] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:10 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:11.813277 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-36d893f1-b697-4b20-8cc2-002099e89bdb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:11.813860 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-36d893f1-b697-4b20-8cc2-002099e89bdb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:11.820604 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-36d893f1-b697-4b20-8cc2-002099e89bdb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:11.821097 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-36d893f1-b697-4b20-8cc2-002099e89bdb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:11.821829 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-36d893f1-b697-4b20-8cc2-002099e89bdb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:11.822264 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-36d893f1-b697-4b20-8cc2-002099e89bdb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:11.906460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-36d893f1-b697-4b20-8cc2-002099e89bdb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lazy-loading 'services' on Instance uuid becf4d4f-6b4d-4815-aad2-7a94716836bd {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:34:11.930972 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b7befe3f-7cbe-4322-ace8-9f3bd4f00ecd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:11.931705 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b7befe3f-7cbe-4322-ace8-9f3bd4f00ecd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:11.941469 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b7befe3f-7cbe-4322-ace8-9f3bd4f00ecd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:11.941913 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b7befe3f-7cbe-4322-ace8-9f3bd4f00ecd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:11.942687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b7befe3f-7cbe-4322-ace8-9f3bd4f00ecd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:11.943150 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b7befe3f-7cbe-4322-ace8-9f3bd4f00ecd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:12.005926 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b7befe3f-7cbe-4322-ace8-9f3bd4f00ecd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:12.014463 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b7befe3f-7cbe-4322-ace8-9f3bd4f00ecd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1245 microversion: 2.1 time: 0.087358 Jul 12 18:34:12.015072 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 394/830] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:11 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:34:12.194533 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-36d893f1-b697-4b20-8cc2-002099e89bdb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "DELETE /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd/os-volume_attachments/7fac22d3-1449-4f25-ae9c-fb768f45a049" status: 202 len: 0 microversion: 2.1 time: 0.387454 Jul 12 18:34:12.195312 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 437/831] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:34:11 2022] DELETE /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd/os-volume_attachments/7fac22d3-1449-4f25-ae9c-fb768f45a049 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:34:13.031592 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-12c5310e-0721-4727-b489-11e0384f1df0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:13.032175 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-12c5310e-0721-4727-b489-11e0384f1df0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:13.038798 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12c5310e-0721-4727-b489-11e0384f1df0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:13.039237 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12c5310e-0721-4727-b489-11e0384f1df0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:13.040000 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12c5310e-0721-4727-b489-11e0384f1df0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:13.040461 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12c5310e-0721-4727-b489-11e0384f1df0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:13.103702 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-12c5310e-0721-4727-b489-11e0384f1df0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:13.111891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-12c5310e-0721-4727-b489-11e0384f1df0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1293 microversion: 2.1 time: 0.084249 Jul 12 18:34:13.112511 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 395/832] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:13 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:14.130160 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-abcdd96a-e5f1-46fa-846f-14152da32cfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:14.130961 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-abcdd96a-e5f1-46fa-846f-14152da32cfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:14.137918 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-abcdd96a-e5f1-46fa-846f-14152da32cfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:14.138366 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-abcdd96a-e5f1-46fa-846f-14152da32cfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:14.139145 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-abcdd96a-e5f1-46fa-846f-14152da32cfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:14.139574 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-abcdd96a-e5f1-46fa-846f-14152da32cfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:14.212381 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-abcdd96a-e5f1-46fa-846f-14152da32cfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:14.220077 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-abcdd96a-e5f1-46fa-846f-14152da32cfd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1299 microversion: 2.1 time: 0.094203 Jul 12 18:34:14.220595 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 438/833] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:14 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:14.396153 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7839a53d-1a7c-4b91-9f92-a455ac869953 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:14.396742 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7839a53d-1a7c-4b91-9f92-a455ac869953 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:14.403940 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7839a53d-1a7c-4b91-9f92-a455ac869953 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:14.404544 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7839a53d-1a7c-4b91-9f92-a455ac869953 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:14.405329 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7839a53d-1a7c-4b91-9f92-a455ac869953 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:14.405786 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7839a53d-1a7c-4b91-9f92-a455ac869953 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:14.434569 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7839a53d-1a7c-4b91-9f92-a455ac869953 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:34:14.823678 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7839a53d-1a7c-4b91-9f92-a455ac869953 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "DELETE /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 204 len: 0 microversion: 2.1 time: 0.431473 Jul 12 18:34:14.825048 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 396/834] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:34:14 2022] DELETE /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:34:14.833038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6843a80c-47bd-4750-ba23-776ddfed49b6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:14.833642 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6843a80c-47bd-4750-ba23-776ddfed49b6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:14.839844 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6843a80c-47bd-4750-ba23-776ddfed49b6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:14.840939 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6843a80c-47bd-4750-ba23-776ddfed49b6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:14.841718 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6843a80c-47bd-4750-ba23-776ddfed49b6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:14.842148 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6843a80c-47bd-4750-ba23-776ddfed49b6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:14.996366 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6843a80c-47bd-4750-ba23-776ddfed49b6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:15.004072 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6843a80c-47bd-4750-ba23-776ddfed49b6 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1514 microversion: 2.1 time: 0.174896 Jul 12 18:34:15.004671 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 439/835] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:14 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:15.241098 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-354865ba-f3a8-40b6-ac31-a537d3e916aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:15.241961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-354865ba-f3a8-40b6-ac31-a537d3e916aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:15.248668 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-354865ba-f3a8-40b6-ac31-a537d3e916aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:15.249118 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-354865ba-f3a8-40b6-ac31-a537d3e916aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:15.249926 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-354865ba-f3a8-40b6-ac31-a537d3e916aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:15.250505 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-354865ba-f3a8-40b6-ac31-a537d3e916aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:15.384177 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-354865ba-f3a8-40b6-ac31-a537d3e916aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:15.392542 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-354865ba-f3a8-40b6-ac31-a537d3e916aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1367 microversion: 2.1 time: 0.155812 Jul 12 18:34:15.393126 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 397/836] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:15 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:15.425266 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-b98c1b41-57ef-4e38-ba12-8c0c4696e288 req-6f471400-4e9d-4998-a5b3-4f77503c45a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b9b5e7-913a-41d9-aa33-32f8831ef300", "tag": "d1eb5351-f6c6-477d-8277-f9b4f415cb8d"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:34:15.431856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-b98c1b41-57ef-4e38-ba12-8c0c4696e288 req-6f471400-4e9d-4998-a5b3-4f77503c45a6 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:15.432556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-b98c1b41-57ef-4e38-ba12-8c0c4696e288 req-6f471400-4e9d-4998-a5b3-4f77503c45a6 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:15.451851 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-b98c1b41-57ef-4e38-ba12-8c0c4696e288 req-6f471400-4e9d-4998-a5b3-4f77503c45a6 service nova] Creating event network-changed:d1eb5351-f6c6-477d-8277-f9b4f415cb8d for instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 on hv-cinder-84488 Jul 12 18:34:15.457199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-b98c1b41-57ef-4e38-ba12-8c0c4696e288 req-6f471400-4e9d-4998-a5b3-4f77503c45a6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041450 Jul 12 18:34:15.458289 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 440/837] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:34:16.021617 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-38d0f47a-a620-42eb-b34d-d6f8ab1ecefb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:16.022220 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-38d0f47a-a620-42eb-b34d-d6f8ab1ecefb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:16.029663 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38d0f47a-a620-42eb-b34d-d6f8ab1ecefb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:16.030105 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38d0f47a-a620-42eb-b34d-d6f8ab1ecefb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:16.030897 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38d0f47a-a620-42eb-b34d-d6f8ab1ecefb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:16.031326 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38d0f47a-a620-42eb-b34d-d6f8ab1ecefb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:16.163802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-38d0f47a-a620-42eb-b34d-d6f8ab1ecefb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:16.172248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-38d0f47a-a620-42eb-b34d-d6f8ab1ecefb tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1514 microversion: 2.1 time: 0.154552 Jul 12 18:34:16.172844 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 398/838] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:16 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:16.410792 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-40c1300f-4ce3-4d20-8fd4-b2e243cd6330 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:16.411491 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-40c1300f-4ce3-4d20-8fd4-b2e243cd6330 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:16.418066 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-40c1300f-4ce3-4d20-8fd4-b2e243cd6330 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:16.418517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-40c1300f-4ce3-4d20-8fd4-b2e243cd6330 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:16.419314 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-40c1300f-4ce3-4d20-8fd4-b2e243cd6330 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:16.419751 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-40c1300f-4ce3-4d20-8fd4-b2e243cd6330 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:16.562979 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-40c1300f-4ce3-4d20-8fd4-b2e243cd6330 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:16.570515 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-40c1300f-4ce3-4d20-8fd4-b2e243cd6330 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1367 microversion: 2.1 time: 0.164364 Jul 12 18:34:16.571085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 441/839] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:16 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:34:17.190174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-81eb08b3-fbd8-4da2-8df8-a23e7085a36a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:17.190786 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-81eb08b3-fbd8-4da2-8df8-a23e7085a36a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:17.199950 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-81eb08b3-fbd8-4da2-8df8-a23e7085a36a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:17.201171 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-81eb08b3-fbd8-4da2-8df8-a23e7085a36a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:17.201953 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-81eb08b3-fbd8-4da2-8df8-a23e7085a36a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:17.202386 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-81eb08b3-fbd8-4da2-8df8-a23e7085a36a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:17.498299 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-81eb08b3-fbd8-4da2-8df8-a23e7085a36a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:17.505944 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-81eb08b3-fbd8-4da2-8df8-a23e7085a36a tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1514 microversion: 2.1 time: 0.319499 Jul 12 18:34:17.506761 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 399/840] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:17 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1514 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:17.588701 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b6169d28-9fa5-43db-9f40-6e0bfa60fa27 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:17.589315 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b6169d28-9fa5-43db-9f40-6e0bfa60fa27 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:17.595956 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b6169d28-9fa5-43db-9f40-6e0bfa60fa27 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:17.596443 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b6169d28-9fa5-43db-9f40-6e0bfa60fa27 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:17.597208 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b6169d28-9fa5-43db-9f40-6e0bfa60fa27 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:17.597638 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b6169d28-9fa5-43db-9f40-6e0bfa60fa27 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:17.697743 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-645254a7-35fd-415b-90b3-5e2fc5315d78 req-09e2136a-38b9-45e6-8feb-18c4d37d0eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "becf4d4f-6b4d-4815-aad2-7a94716836bd", "name": "network-vif-deleted", "tag": "2ea2c977-7f64-4fc3-9e1d-15585961b702"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:34:17.707009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-645254a7-35fd-415b-90b3-5e2fc5315d78 req-09e2136a-38b9-45e6-8feb-18c4d37d0eb3 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:17.707702 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-645254a7-35fd-415b-90b3-5e2fc5315d78 req-09e2136a-38b9-45e6-8feb-18c4d37d0eb3 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:17.718741 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-645254a7-35fd-415b-90b3-5e2fc5315d78 req-09e2136a-38b9-45e6-8feb-18c4d37d0eb3 service nova] Creating event network-vif-deleted:2ea2c977-7f64-4fc3-9e1d-15585961b702 for instance becf4d4f-6b4d-4815-aad2-7a94716836bd on hv-cinder-84488 Jul 12 18:34:17.723682 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-645254a7-35fd-415b-90b3-5e2fc5315d78 req-09e2136a-38b9-45e6-8feb-18c4d37d0eb3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029570 Jul 12 18:34:17.724396 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 400/841] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:34:17.737739 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b6169d28-9fa5-43db-9f40-6e0bfa60fa27 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:17.750016 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b6169d28-9fa5-43db-9f40-6e0bfa60fa27 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1367 microversion: 2.1 time: 0.160900 Jul 12 18:34:17.750016 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 442/842] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:17 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:18.524841 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-865b7865-3e27-4a52-b4fe-5989f08e4389 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:18.525538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-865b7865-3e27-4a52-b4fe-5989f08e4389 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:18.533304 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-865b7865-3e27-4a52-b4fe-5989f08e4389 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:18.539776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-865b7865-3e27-4a52-b4fe-5989f08e4389 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:18.539776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-865b7865-3e27-4a52-b4fe-5989f08e4389 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:18.539776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-865b7865-3e27-4a52-b4fe-5989f08e4389 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:18.608351 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-865b7865-3e27-4a52-b4fe-5989f08e4389 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c44ad4254a46beba4a8a2ca5175f82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246cc971eb1a4882868c39c39d27e3f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:18.615956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-865b7865-3e27-4a52-b4fe-5989f08e4389 tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 200 len: 1304 microversion: 2.1 time: 0.095971 Jul 12 18:34:18.616566 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 401/843] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:18 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:18.763695 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2634f3fe-1ba6-4810-80e5-5c59296205df tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:18.764274 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2634f3fe-1ba6-4810-80e5-5c59296205df tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:18.770809 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2634f3fe-1ba6-4810-80e5-5c59296205df tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:18.771254 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2634f3fe-1ba6-4810-80e5-5c59296205df tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:18.772008 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2634f3fe-1ba6-4810-80e5-5c59296205df tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:18.772469 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2634f3fe-1ba6-4810-80e5-5c59296205df tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:18.912088 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-2634f3fe-1ba6-4810-80e5-5c59296205df tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:18.916535 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2634f3fe-1ba6-4810-80e5-5c59296205df tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1367 microversion: 2.1 time: 0.157341 Jul 12 18:34:18.917105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 443/844] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:18 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:19.634483 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8f838b62-fffb-4a45-81f5-8d2058d7472d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:19.635093 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8f838b62-fffb-4a45-81f5-8d2058d7472d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] [instance: becf4d4f-6b4d-4815-aad2-7a94716836bd] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:19.642490 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f838b62-fffb-4a45-81f5-8d2058d7472d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:19.642926 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f838b62-fffb-4a45-81f5-8d2058d7472d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:19.643730 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f838b62-fffb-4a45-81f5-8d2058d7472d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:19.644158 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f838b62-fffb-4a45-81f5-8d2058d7472d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:19.658309 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-8f838b62-fffb-4a45-81f5-8d2058d7472d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] HTTP exception thrown: Instance becf4d4f-6b4d-4815-aad2-7a94716836bd could not be found. Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8f838b62-fffb-4a45-81f5-8d2058d7472d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Request method failure captured: Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd HTTP/1.1 Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb4rhub59voKX1K2VvH2apd1aa7SIjeHoioDL7EvxoHv5brkBKvydAaWD3r6KX8rh0L3MCJ-wTgFKUcbzId4k4rYhQZAj2TfSwWFXiFqATbzaI1QQH9PsRcbQw41J1tFIE1j-Kf07nW_s1U2IGOZlPLX2oYxWrb7kTBXEDqTkkxqj8Y Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 246cc971eb1a4882868c39c39d27e3f5 Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesSnapshotTestJSON-383250509 Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:34:19.660004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/246cc971eb1a4882868c39c39d27e3f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/246cc971eb1a4882868c39c39d27e3f5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_246cc971eb1a4882868c39c39d27e3f5", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/246cc971eb1a4882868c39c39d27e3f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesSnapshotTestJSON-383250509 Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 246cc971eb1a4882868c39c39d27e3f5 Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-383250509 Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesSnapshotTestJSON-383250509-project Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 38c44ad4254a46beba4a8a2ca5175f82 Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesSnapshotTestJSON-383250509-project Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance becf4d4f-6b4d-4815-aad2-7a94716836bd could not be found. Jul 12 18:34:19.661937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'becf4d4f-6b4d-4815-aad2-7a94716836bd'} Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance becf4d4f-6b4d-4815-aad2-7a94716836bd could not be found. Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:34:19.663591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance becf4d4f-6b4d-4815-aad2-7a94716836bd could not be found. Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance becf4d4f-6b4d-4815-aad2-7a94716836bd could not be found. Jul 12 18:34:19.665472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:34:19.666913 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8f838b62-fffb-4a45-81f5-8d2058d7472d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] Returning 404 to user: Instance becf4d4f-6b4d-4815-aad2-7a94716836bd could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:34:19.666913 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8f838b62-fffb-4a45-81f5-8d2058d7472d tempest-VolumesSnapshotTestJSON-383250509 tempest-VolumesSnapshotTestJSON-383250509-project] 10.222.0.47 "GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd" status: 404 len: 111 microversion: 2.1 time: 0.031195 Jul 12 18:34:19.666913 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 402/845] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:19 2022] GET /compute/v2.1/servers/becf4d4f-6b4d-4815-aad2-7a94716836bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:34:19.933139 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8363d35e-03d6-4ac0-9137-ee4fbaeca2ca tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:19.933738 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8363d35e-03d6-4ac0-9137-ee4fbaeca2ca tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:19.940771 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8363d35e-03d6-4ac0-9137-ee4fbaeca2ca tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:19.941307 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8363d35e-03d6-4ac0-9137-ee4fbaeca2ca tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:19.941960 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8363d35e-03d6-4ac0-9137-ee4fbaeca2ca tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:19.942390 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8363d35e-03d6-4ac0-9137-ee4fbaeca2ca tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:20.090537 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8363d35e-03d6-4ac0-9137-ee4fbaeca2ca tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:20.098235 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8363d35e-03d6-4ac0-9137-ee4fbaeca2ca tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1367 microversion: 2.1 time: 0.169061 Jul 12 18:34:20.098795 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 444/846] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:19 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:21.115057 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4759c3bb-67cf-4c09-8997-9055d6b83d48 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:21.115658 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4759c3bb-67cf-4c09-8997-9055d6b83d48 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:21.118576 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:21.123950 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4759c3bb-67cf-4c09-8997-9055d6b83d48 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:21.124432 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4759c3bb-67cf-4c09-8997-9055d6b83d48 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:21.125184 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4759c3bb-67cf-4c09-8997-9055d6b83d48 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:21.125605 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4759c3bb-67cf-4c09-8997-9055d6b83d48 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:21.263640 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4759c3bb-67cf-4c09-8997-9055d6b83d48 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:21.271772 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4759c3bb-67cf-4c09-8997-9055d6b83d48 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1367 microversion: 2.1 time: 0.160614 Jul 12 18:34:21.272359 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 403/847] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:21 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:21.825761 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-7d162c57-931d-4f18-82a9-b292156d01fc req-4c7d5069-d58a-4b5b-afda-7f3ff47586e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b9b5e7-913a-41d9-aa33-32f8831ef300", "name": "network-vif-plugged", "status": "completed", "tag": "d1eb5351-f6c6-477d-8277-f9b4f415cb8d"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:34:21.829310 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:21.829984 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=6 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:21.835741 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-7d162c57-931d-4f18-82a9-b292156d01fc req-4c7d5069-d58a-4b5b-afda-7f3ff47586e0 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:21.836179 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-7d162c57-931d-4f18-82a9-b292156d01fc req-4c7d5069-d58a-4b5b-afda-7f3ff47586e0 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:21.847310 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-7d162c57-931d-4f18-82a9-b292156d01fc req-4c7d5069-d58a-4b5b-afda-7f3ff47586e0 service nova] Creating event network-vif-plugged:d1eb5351-f6c6-477d-8277-f9b4f415cb8d for instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 on hv-cinder-84488 Jul 12 18:34:21.852115 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-7d162c57-931d-4f18-82a9-b292156d01fc req-4c7d5069-d58a-4b5b-afda-7f3ff47586e0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030225 Jul 12 18:34:21.852731 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 445/848] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:34:22.288865 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-448c11a7-a31c-4a51-be1e-d741af4a78d9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:22.289447 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-448c11a7-a31c-4a51-be1e-d741af4a78d9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:22.296753 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-448c11a7-a31c-4a51-be1e-d741af4a78d9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:22.297189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-448c11a7-a31c-4a51-be1e-d741af4a78d9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:22.297941 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-448c11a7-a31c-4a51-be1e-d741af4a78d9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:22.298365 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-448c11a7-a31c-4a51-be1e-d741af4a78d9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:22.426170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-448c11a7-a31c-4a51-be1e-d741af4a78d9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:22.433477 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-448c11a7-a31c-4a51-be1e-d741af4a78d9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1367 microversion: 2.1 time: 0.148498 Jul 12 18:34:22.434039 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 404/849] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:22 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:23.451083 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-05a8f813-9ac4-44a1-a96a-b334911a9f44 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:23.451991 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-05a8f813-9ac4-44a1-a96a-b334911a9f44 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:23.459262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05a8f813-9ac4-44a1-a96a-b334911a9f44 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:23.459706 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05a8f813-9ac4-44a1-a96a-b334911a9f44 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:23.460504 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05a8f813-9ac4-44a1-a96a-b334911a9f44 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:23.460933 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-05a8f813-9ac4-44a1-a96a-b334911a9f44 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:23.597944 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-05a8f813-9ac4-44a1-a96a-b334911a9f44 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:23.605365 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-05a8f813-9ac4-44a1-a96a-b334911a9f44 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1367 microversion: 2.1 time: 0.158995 Jul 12 18:34:23.605913 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 446/850] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:23 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:24.624154 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c09daf08-d323-4e24-a9b0-aa871dce7255 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:24.625086 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c09daf08-d323-4e24-a9b0-aa871dce7255 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:24.631903 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c09daf08-d323-4e24-a9b0-aa871dce7255 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:24.632364 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c09daf08-d323-4e24-a9b0-aa871dce7255 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:24.633132 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c09daf08-d323-4e24-a9b0-aa871dce7255 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:24.633560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c09daf08-d323-4e24-a9b0-aa871dce7255 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:24.761046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c09daf08-d323-4e24-a9b0-aa871dce7255 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:24.769024 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c09daf08-d323-4e24-a9b0-aa871dce7255 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1367 microversion: 2.1 time: 0.149512 Jul 12 18:34:24.769738 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 405/851] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:24 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:25.786330 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-57f3cc35-8ff6-4749-b24c-8b59399317c0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:25.786895 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-57f3cc35-8ff6-4749-b24c-8b59399317c0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:25.793341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-57f3cc35-8ff6-4749-b24c-8b59399317c0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:25.793782 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-57f3cc35-8ff6-4749-b24c-8b59399317c0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:25.794531 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-57f3cc35-8ff6-4749-b24c-8b59399317c0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:25.794972 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-57f3cc35-8ff6-4749-b24c-8b59399317c0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:25.927673 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-57f3cc35-8ff6-4749-b24c-8b59399317c0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:25.936141 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-57f3cc35-8ff6-4749-b24c-8b59399317c0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1367 microversion: 2.1 time: 0.153385 Jul 12 18:34:25.936848 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 447/852] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:25 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:26.953610 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2c96273c-5771-4d21-b16f-c952ce5b1b1f tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:26.954700 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2c96273c-5771-4d21-b16f-c952ce5b1b1f tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:26.961446 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2c96273c-5771-4d21-b16f-c952ce5b1b1f tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:26.961887 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2c96273c-5771-4d21-b16f-c952ce5b1b1f tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:26.962653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2c96273c-5771-4d21-b16f-c952ce5b1b1f tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:26.963085 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2c96273c-5771-4d21-b16f-c952ce5b1b1f tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:27.097333 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2c96273c-5771-4d21-b16f-c952ce5b1b1f tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:34:27.105442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2c96273c-5771-4d21-b16f-c952ce5b1b1f tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1557 microversion: 2.1 time: 0.155914 Jul 12 18:34:27.107500 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 406/853] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:34:26 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:34:27.124659 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-30adb9c7-6098-4342-95e4-5ff9934606e5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:34:27.125550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-30adb9c7-6098-4342-95e4-5ff9934606e5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:34:27.132725 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30adb9c7-6098-4342-95e4-5ff9934606e5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:27.133246 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30adb9c7-6098-4342-95e4-5ff9934606e5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:27.134022 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30adb9c7-6098-4342-95e4-5ff9934606e5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:27.134451 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30adb9c7-6098-4342-95e4-5ff9934606e5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:27.215678 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-30adb9c7-6098-4342-95e4-5ff9934606e5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095232 Jul 12 18:34:27.216265 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 448/854] 10.222.0.47 () {58 vars in 1274 bytes} [Tue Jul 12 18:34:27 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:34:28.217618 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-d462efff-f022-4cf5-b7ac-b7281991f2ab req-651ada90-f5b4-4199-ab26-21293f9b838e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62b9b5e7-913a-41d9-aa33-32f8831ef300", "tag": "d1eb5351-f6c6-477d-8277-f9b4f415cb8d"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:34:28.227804 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-d462efff-f022-4cf5-b7ac-b7281991f2ab req-651ada90-f5b4-4199-ab26-21293f9b838e service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:34:28.228229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-d462efff-f022-4cf5-b7ac-b7281991f2ab req-651ada90-f5b4-4199-ab26-21293f9b838e service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:34:28.396517 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-d462efff-f022-4cf5-b7ac-b7281991f2ab req-651ada90-f5b4-4199-ab26-21293f9b838e service nova] Creating event network-changed:d1eb5351-f6c6-477d-8277-f9b4f415cb8d for instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 on hv-cinder-84488 Jul 12 18:34:28.401692 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-d462efff-f022-4cf5-b7ac-b7281991f2ab req-651ada90-f5b4-4199-ab26-21293f9b838e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187700 Jul 12 18:34:28.407808 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 407/855] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:04.128440 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:04.129134 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:04.133159 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-63f13f4f-5934-4559-bbda-e7f3a011a058 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:04.133646 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-63f13f4f-5934-4559-bbda-e7f3a011a058 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:04.139570 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-63f13f4f-5934-4559-bbda-e7f3a011a058 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:04.140583 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-63f13f4f-5934-4559-bbda-e7f3a011a058 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:04.141388 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-63f13f4f-5934-4559-bbda-e7f3a011a058 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:04.141811 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-63f13f4f-5934-4559-bbda-e7f3a011a058 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:04.165322 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-63f13f4f-5934-4559-bbda-e7f3a011a058 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300/ips" status: 200 len: 149 microversion: 2.1 time: 0.038586 Jul 12 18:35:04.165891 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 449/856] 10.222.0.47 () {58 vars in 1247 bytes} [Tue Jul 12 18:35:04 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:04.174368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:04.175114 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:04.179291 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b0955a53-c06e-4a24-b1b8-b3fc54c4f35c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e45c01b2-04ee-43a3-a5cb-bd9bdbc355db"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:35:04.180432 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b0955a53-c06e-4a24-b1b8-b3fc54c4f35c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:04.186414 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0955a53-c06e-4a24-b1b8-b3fc54c4f35c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:04.187449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0955a53-c06e-4a24-b1b8-b3fc54c4f35c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:04.188197 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0955a53-c06e-4a24-b1b8-b3fc54c4f35c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:04.188642 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0955a53-c06e-4a24-b1b8-b3fc54c4f35c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:04.270257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-b0955a53-c06e-4a24-b1b8-b3fc54c4f35c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Invalid volume: volume e45c01b2-04ee-43a3-a5cb-bd9bdbc355db is already attached to instances: ccee0a08-5b3a-4857-a132-58abc74ebdb7 Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b0955a53-c06e-4a24-b1b8-b3fc54c4f35c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: POST /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300/os-volume_attachments HTTP/1.1 Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 74 Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:35:04.272054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {"volumeAttachment": {"volumeId": "e45c01b2-04ee-43a3-a5cb-bd9bdbc355db"}} Jul 12 18:35:04.273878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Invalid volume: volume e45c01b2-04ee-43a3-a5cb-bd9bdbc355db is already attached to instances: ccee0a08-5b3a-4857-a132-58abc74ebdb7 Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'server_id': '62b9b5e7-913a-41d9-aa33-32f8831ef300', 'body': {'volumeAttachment': {'volumeId': 'e45c01b2-04ee-43a3-a5cb-bd9bdbc355db'}}} Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e45c01b2-04ee-43a3-a5cb-bd9bdbc355db is already attached to instances: ccee0a08-5b3a-4857-a132-58abc74ebdb7 Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:35:04.274846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e45c01b2-04ee-43a3-a5cb-bd9bdbc355db is already attached to instances: ccee0a08-5b3a-4857-a132-58abc74ebdb7 Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:35:04.276257 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:35:04.278248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:35:04.278248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:35:04.278248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:35:04.278248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e45c01b2-04ee-43a3-a5cb-bd9bdbc355db is already attached to instances: ccee0a08-5b3a-4857-a132-58abc74ebdb7 Jul 12 18:35:04.278248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:35:04.278248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b0955a53-c06e-4a24-b1b8-b3fc54c4f35c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 400 to user: Invalid volume: volume e45c01b2-04ee-43a3-a5cb-bd9bdbc355db is already attached to instances: ccee0a08-5b3a-4857-a132-58abc74ebdb7 {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:35:04.278248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b0955a53-c06e-4a24-b1b8-b3fc54c4f35c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100957 Jul 12 18:35:04.278248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 408/857] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:35:04 2022] POST /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:35:04.283022 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b283e2a8-c83c-4cb5-b23d-3a9b7a20a0ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:04.283508 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b283e2a8-c83c-4cb5-b23d-3a9b7a20a0ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:04.290461 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b283e2a8-c83c-4cb5-b23d-3a9b7a20a0ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:04.292908 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b283e2a8-c83c-4cb5-b23d-3a9b7a20a0ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:04.292908 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b283e2a8-c83c-4cb5-b23d-3a9b7a20a0ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:04.292908 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b283e2a8-c83c-4cb5-b23d-3a9b7a20a0ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:04.317897 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b283e2a8-c83c-4cb5-b23d-3a9b7a20a0ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:35:04.708458 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b283e2a8-c83c-4cb5-b23d-3a9b7a20a0ba tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 204 len: 0 microversion: 2.1 time: 0.429671 Jul 12 18:35:04.708975 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 450/858] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:35:04 2022] DELETE /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:35:04.717762 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0142967e-d2c2-40d1-8783-6aac24a8d727 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:04.718381 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0142967e-d2c2-40d1-8783-6aac24a8d727 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:04.726754 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0142967e-d2c2-40d1-8783-6aac24a8d727 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:04.727194 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0142967e-d2c2-40d1-8783-6aac24a8d727 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:04.727955 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0142967e-d2c2-40d1-8783-6aac24a8d727 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:04.728409 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0142967e-d2c2-40d1-8783-6aac24a8d727 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:04.864540 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0142967e-d2c2-40d1-8783-6aac24a8d727 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:04.872449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0142967e-d2c2-40d1-8783-6aac24a8d727 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1681 microversion: 2.1 time: 0.159040 Jul 12 18:35:04.872881 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 409/859] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:04 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:05.890645 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9dd72204-21c2-4554-9edc-cf6498a00e88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:05.891341 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9dd72204-21c2-4554-9edc-cf6498a00e88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:05.897776 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9dd72204-21c2-4554-9edc-cf6498a00e88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:05.898219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9dd72204-21c2-4554-9edc-cf6498a00e88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:05.898988 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9dd72204-21c2-4554-9edc-cf6498a00e88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:05.899418 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9dd72204-21c2-4554-9edc-cf6498a00e88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:06.035801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9dd72204-21c2-4554-9edc-cf6498a00e88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:06.043598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9dd72204-21c2-4554-9edc-cf6498a00e88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1681 microversion: 2.1 time: 0.157312 Jul 12 18:35:06.046103 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 451/860] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:05 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:07.061731 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-16fbc2dd-04ff-4789-aab2-fba1f941ff92 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:07.062808 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-16fbc2dd-04ff-4789-aab2-fba1f941ff92 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:07.070308 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16fbc2dd-04ff-4789-aab2-fba1f941ff92 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:07.070692 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16fbc2dd-04ff-4789-aab2-fba1f941ff92 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:07.071462 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16fbc2dd-04ff-4789-aab2-fba1f941ff92 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:07.071891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16fbc2dd-04ff-4789-aab2-fba1f941ff92 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:07.320630 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-16fbc2dd-04ff-4789-aab2-fba1f941ff92 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:07.329233 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-16fbc2dd-04ff-4789-aab2-fba1f941ff92 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1613 microversion: 2.1 time: 0.271214 Jul 12 18:35:07.338850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 410/861] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:07 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1613 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:07.395896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-65e76d94-845c-48a0-94e1-1368df2b2421 req-e78600c1-8443-482b-87a0-5510a3c1ff4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62b9b5e7-913a-41d9-aa33-32f8831ef300", "name": "network-vif-deleted", "tag": "d1eb5351-f6c6-477d-8277-f9b4f415cb8d"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:35:07.404017 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-65e76d94-845c-48a0-94e1-1368df2b2421 req-e78600c1-8443-482b-87a0-5510a3c1ff4c service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:07.404435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-65e76d94-845c-48a0-94e1-1368df2b2421 req-e78600c1-8443-482b-87a0-5510a3c1ff4c service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:07.416363 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-65e76d94-845c-48a0-94e1-1368df2b2421 req-e78600c1-8443-482b-87a0-5510a3c1ff4c service nova] Creating event network-vif-deleted:d1eb5351-f6c6-477d-8277-f9b4f415cb8d for instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 on hv-cinder-84488 Jul 12 18:35:07.421189 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-65e76d94-845c-48a0-94e1-1368df2b2421 req-e78600c1-8443-482b-87a0-5510a3c1ff4c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029735 Jul 12 18:35:07.421842 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 452/862] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:08.348170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7290d287-db35-4e8d-90a8-2915548cd94c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:08.350543 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7290d287-db35-4e8d-90a8-2915548cd94c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:08.357200 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7290d287-db35-4e8d-90a8-2915548cd94c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:08.357916 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7290d287-db35-4e8d-90a8-2915548cd94c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:08.359015 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7290d287-db35-4e8d-90a8-2915548cd94c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:08.360608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7290d287-db35-4e8d-90a8-2915548cd94c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:08.404504 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7290d287-db35-4e8d-90a8-2915548cd94c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:08.405046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7290d287-db35-4e8d-90a8-2915548cd94c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:08.405383 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-7290d287-db35-4e8d-90a8-2915548cd94c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lazy-loading 'fault' on Instance uuid 62b9b5e7-913a-41d9-aa33-32f8831ef300 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:35:08.447940 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7290d287-db35-4e8d-90a8-2915548cd94c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:08.456691 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7290d287-db35-4e8d-90a8-2915548cd94c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 200 len: 1331 microversion: 2.1 time: 0.113786 Jul 12 18:35:08.457266 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 411/863] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:08 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:09.474898 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-579e7370-5e32-4163-8ab3-febaa313d4f3 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:09.475571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-579e7370-5e32-4163-8ab3-febaa313d4f3 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:09.481812 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-579e7370-5e32-4163-8ab3-febaa313d4f3 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:09.482253 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-579e7370-5e32-4163-8ab3-febaa313d4f3 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:09.483032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-579e7370-5e32-4163-8ab3-febaa313d4f3 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:09.483456 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-579e7370-5e32-4163-8ab3-febaa313d4f3 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:09.496717 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-579e7370-5e32-4163-8ab3-febaa313d4f3 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-579e7370-5e32-4163-8ab3-febaa313d4f3 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 HTTP/1.1 Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:35:09.498304 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:35:09.500435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': '62b9b5e7-913a-41d9-aa33-32f8831ef300'} Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:35:09.501337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:35:09.502905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:35:09.504671 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-579e7370-5e32-4163-8ab3-febaa313d4f3 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:35:09.504671 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-579e7370-5e32-4163-8ab3-febaa313d4f3 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 404 len: 111 microversion: 2.1 time: 0.029420 Jul 12 18:35:09.504671 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 453/864] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:09 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:35:09.509153 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-29fe67d3-99ea-45f9-a1cd-798fcba3beb6 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '.version_select at 0x7f1bb09bf9d0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:09.596086 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-29fe67d3-99ea-45f9-a1cd-798fcba3beb6 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-958473933" status: 202 len: 0 microversion: 2.1 time: 0.090816 Jul 12 18:35:09.596694 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 412/865] 10.222.0.47 () {58 vars in 1217 bytes} [Tue Jul 12 18:35:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-958473933 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:35:10.430639 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fbd50435-13c9-4ee5-95e9-65eb9989b449 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:10.431130 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fbd50435-13c9-4ee5-95e9-65eb9989b449 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:10.437768 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbd50435-13c9-4ee5-95e9-65eb9989b449 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:10.438413 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbd50435-13c9-4ee5-95e9-65eb9989b449 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:10.439200 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbd50435-13c9-4ee5-95e9-65eb9989b449 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:10.439637 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbd50435-13c9-4ee5-95e9-65eb9989b449 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:10.747818 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-fbd50435-13c9-4ee5-95e9-65eb9989b449 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lazy-loading 'services' on Instance uuid ccee0a08-5b3a-4857-a132-58abc74ebdb7 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:35:10.989393 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fbd50435-13c9-4ee5-95e9-65eb9989b449 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-volume_attachments/e45c01b2-04ee-43a3-a5cb-bd9bdbc355db" status: 202 len: 0 microversion: 2.1 time: 0.562397 Jul 12 18:35:10.990035 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 454/866] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:35:10 2022] DELETE /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-volume_attachments/e45c01b2-04ee-43a3-a5cb-bd9bdbc355db => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:35:10.999018 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-241a3f52-953a-4e6c-9fc1-f036b4a04d53 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:11.000132 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-241a3f52-953a-4e6c-9fc1-f036b4a04d53 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:11.007580 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-241a3f52-953a-4e6c-9fc1-f036b4a04d53 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:11.008077 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-241a3f52-953a-4e6c-9fc1-f036b4a04d53 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:11.008873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-241a3f52-953a-4e6c-9fc1-f036b4a04d53 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:11.009306 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-241a3f52-953a-4e6c-9fc1-f036b4a04d53 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:11.040671 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-241a3f52-953a-4e6c-9fc1-f036b4a04d53 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045704 Jul 12 18:35:11.041404 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 413/867] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:35:10 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:12.053427 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0469ddcd-4fe9-4785-a5b5-d06e5448ec80 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:12.054409 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0469ddcd-4fe9-4785-a5b5-d06e5448ec80 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:12.061164 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0469ddcd-4fe9-4785-a5b5-d06e5448ec80 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:12.061691 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0469ddcd-4fe9-4785-a5b5-d06e5448ec80 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:12.062394 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0469ddcd-4fe9-4785-a5b5-d06e5448ec80 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:12.062829 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0469ddcd-4fe9-4785-a5b5-d06e5448ec80 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:12.092984 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0469ddcd-4fe9-4785-a5b5-d06e5448ec80 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Jul 12 18:35:12.093540 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 455/868] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:35:12 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:13.105451 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c2a05c32-1feb-41cb-813d-2591ca3be5e8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:13.106656 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c2a05c32-1feb-41cb-813d-2591ca3be5e8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:13.113837 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c2a05c32-1feb-41cb-813d-2591ca3be5e8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:13.114282 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c2a05c32-1feb-41cb-813d-2591ca3be5e8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:13.115084 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c2a05c32-1feb-41cb-813d-2591ca3be5e8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:13.115521 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c2a05c32-1feb-41cb-813d-2591ca3be5e8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:13.145794 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c2a05c32-1feb-41cb-813d-2591ca3be5e8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044311 Jul 12 18:35:13.146380 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 414/869] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:35:13 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:35:13.202987 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d2133451-1ffa-4c33-a478-9d6389547d5d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:13.203502 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d2133451-1ffa-4c33-a478-9d6389547d5d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:13.210114 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d2133451-1ffa-4c33-a478-9d6389547d5d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:13.210559 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d2133451-1ffa-4c33-a478-9d6389547d5d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:13.211316 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d2133451-1ffa-4c33-a478-9d6389547d5d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:13.211747 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d2133451-1ffa-4c33-a478-9d6389547d5d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:13.237742 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d2133451-1ffa-4c33-a478-9d6389547d5d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:35:13.736908 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d2133451-1ffa-4c33-a478-9d6389547d5d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 204 len: 0 microversion: 2.1 time: 0.537325 Jul 12 18:35:13.737419 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 456/870] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:35:13 2022] DELETE /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:35:13.745977 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1663ab87-6d0f-48d6-9348-be5c522784c8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:13.746577 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1663ab87-6d0f-48d6-9348-be5c522784c8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:13.752964 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1663ab87-6d0f-48d6-9348-be5c522784c8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:13.757509 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1663ab87-6d0f-48d6-9348-be5c522784c8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:13.757509 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1663ab87-6d0f-48d6-9348-be5c522784c8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:13.757509 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1663ab87-6d0f-48d6-9348-be5c522784c8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:13.987758 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1663ab87-6d0f-48d6-9348-be5c522784c8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:13.995328 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1663ab87-6d0f-48d6-9348-be5c522784c8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1678 microversion: 2.1 time: 0.253406 Jul 12 18:35:13.995881 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 415/871] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:13 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:15.013849 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1aa05644-d38e-4b7a-ba19-0c37af06dfb4 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:15.014549 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1aa05644-d38e-4b7a-ba19-0c37af06dfb4 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:15.021892 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1aa05644-d38e-4b7a-ba19-0c37af06dfb4 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:15.022335 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1aa05644-d38e-4b7a-ba19-0c37af06dfb4 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:15.023095 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1aa05644-d38e-4b7a-ba19-0c37af06dfb4 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:15.023519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1aa05644-d38e-4b7a-ba19-0c37af06dfb4 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:15.156287 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1aa05644-d38e-4b7a-ba19-0c37af06dfb4 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:15.164424 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1aa05644-d38e-4b7a-ba19-0c37af06dfb4 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1678 microversion: 2.1 time: 0.154917 Jul 12 18:35:15.164922 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 457/872] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:15 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:16.182295 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c5ee320e-3694-4153-839b-54e7d2f92435 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:16.182913 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c5ee320e-3694-4153-839b-54e7d2f92435 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:16.190368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c5ee320e-3694-4153-839b-54e7d2f92435 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:16.190811 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c5ee320e-3694-4153-839b-54e7d2f92435 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:16.191584 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c5ee320e-3694-4153-839b-54e7d2f92435 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:16.192007 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c5ee320e-3694-4153-839b-54e7d2f92435 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:16.289369 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c5ee320e-3694-4153-839b-54e7d2f92435 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:16.297025 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c5ee320e-3694-4153-839b-54e7d2f92435 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1610 microversion: 2.1 time: 0.118622 Jul 12 18:35:16.297597 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 416/873] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:16 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1610 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:16.514704 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-bc4e6321-28e8-4312-8a9f-80f540d548ad req-857015f1-5603-455f-bb08-416eab5790fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccee0a08-5b3a-4857-a132-58abc74ebdb7", "name": "network-vif-deleted", "tag": "f7c7a214-b79d-4e3e-9a63-c3217155820e"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:35:16.523818 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-bc4e6321-28e8-4312-8a9f-80f540d548ad req-857015f1-5603-455f-bb08-416eab5790fd service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:16.524235 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-bc4e6321-28e8-4312-8a9f-80f540d548ad req-857015f1-5603-455f-bb08-416eab5790fd service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:16.536403 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-bc4e6321-28e8-4312-8a9f-80f540d548ad req-857015f1-5603-455f-bb08-416eab5790fd service nova] Creating event network-vif-deleted:f7c7a214-b79d-4e3e-9a63-c3217155820e for instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 on hv-cinder-84488 Jul 12 18:35:16.541672 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-bc4e6321-28e8-4312-8a9f-80f540d548ad req-857015f1-5603-455f-bb08-416eab5790fd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030624 Jul 12 18:35:16.542725 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 458/874] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:17.315263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-75b3dd96-1ba9-4e80-a5a3-2bbcea150f2d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:17.318327 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-75b3dd96-1ba9-4e80-a5a3-2bbcea150f2d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:17.322970 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75b3dd96-1ba9-4e80-a5a3-2bbcea150f2d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:17.323476 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75b3dd96-1ba9-4e80-a5a3-2bbcea150f2d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:17.324349 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75b3dd96-1ba9-4e80-a5a3-2bbcea150f2d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:17.324784 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75b3dd96-1ba9-4e80-a5a3-2bbcea150f2d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:17.358754 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75b3dd96-1ba9-4e80-a5a3-2bbcea150f2d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:17.359160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75b3dd96-1ba9-4e80-a5a3-2bbcea150f2d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:17.359628 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-75b3dd96-1ba9-4e80-a5a3-2bbcea150f2d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lazy-loading 'fault' on Instance uuid ccee0a08-5b3a-4857-a132-58abc74ebdb7 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:35:17.404426 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-75b3dd96-1ba9-4e80-a5a3-2bbcea150f2d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:17.412424 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-75b3dd96-1ba9-4e80-a5a3-2bbcea150f2d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 200 len: 1326 microversion: 2.1 time: 0.101237 Jul 12 18:35:17.413002 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 417/875] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:17 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:18.430939 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9d5afbb1-296b-4fdc-8fc3-50f82fca2705 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:18.431763 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9d5afbb1-296b-4fdc-8fc3-50f82fca2705 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:18.439136 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d5afbb1-296b-4fdc-8fc3-50f82fca2705 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:18.439605 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d5afbb1-296b-4fdc-8fc3-50f82fca2705 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:18.440500 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d5afbb1-296b-4fdc-8fc3-50f82fca2705 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:18.440935 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9d5afbb1-296b-4fdc-8fc3-50f82fca2705 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:18.455393 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-9d5afbb1-296b-4fdc-8fc3-50f82fca2705 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9d5afbb1-296b-4fdc-8fc3-50f82fca2705 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 HTTP/1.1 Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:35:18.457096 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:35:18.458762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': 'ccee0a08-5b3a-4857-a132-58abc74ebdb7'} Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:35:18.463178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:35:18.464488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:35:18.465666 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9d5afbb1-296b-4fdc-8fc3-50f82fca2705 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:35:18.465666 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9d5afbb1-296b-4fdc-8fc3-50f82fca2705 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 404 len: 111 microversion: 2.1 time: 0.031836 Jul 12 18:35:18.465666 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 459/876] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:18 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:35:18.467766 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3fb47cc8-0c69-46b1-8644-fbd47c234c30 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '.version_select at 0x7f1bb08461f0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:18.590256 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3fb47cc8-0c69-46b1-8644-fbd47c234c30 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-82334" status: 202 len: 0 microversion: 2.1 time: 0.126431 Jul 12 18:35:18.590786 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 418/877] 10.222.0.47 () {58 vars in 1205 bytes} [Tue Jul 12 18:35:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-82334 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:35:19.457989 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4c344a74-3704-449f-bd96-ac0819aa7991 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: .version_select at 0x7f1bb0946ca0>, body: {"keypair": {"name": "tempest-keypair-922027170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBvJ4zfpjlqMRaOlYs/ZbH1v3KPMezjLdACiAe6oTwY65SyqQo8kTSg85I01lmSk2GvLK0AHyXbdwkoPTIr26FpS3dLsBahyhRXF131H5GPaRnaQjb0+O9JTRGRqlcILQ=="}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:35:19.473011 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-4c344a74-3704-449f-bd96-ac0819aa7991 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for project cec39457db974eebbc0305cc555a64d4. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:35:19.476996 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-4c344a74-3704-449f-bd96-ac0819aa7991 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for user 4d41a6703cec435dbb7e687aa0088d05 and project cec39457db974eebbc0305cc555a64d4. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:35:19.573294 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4c344a74-3704-449f-bd96-ac0819aa7991 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119820 Jul 12 18:35:19.573880 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 460/878] 10.222.0.47 () {60 vars in 1158 bytes} [Tue Jul 12 18:35:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:22.333350 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-564525588", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "363a49e9-fc6d-4564-a5c2-668089b41523"}], "security_groups": [{"name": "tempest-securitygroup--432643332"}], "key_name": "tempest-keypair-922027170", "user_data": "}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:35:22.434967 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] validate_networks() for [('363a49e9-fc6d-4564-a5c2-668089b41523', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:35:22.850434 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:35:22.850938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:35:22.851455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:35:22.851873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:35:22.852289 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:35:22.861860 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:22.862318 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:22.863112 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:22.863572 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:22.881469 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for project cec39457db974eebbc0305cc555a64d4. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:35:22.885391 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for user 4d41a6703cec435dbb7e687aa0088d05 and project cec39457db974eebbc0305cc555a64d4. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:35:22.896108 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:35:22.898344 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:35:23.047032 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR oslo.messaging._drivers.impl_rabbit [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [ea44e60b-2dad-44f6-b781-00a85a814e75] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 12 18:35:24.055694 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [ea44e60b-2dad-44f6-b781-00a85a814e75] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 57770. Jul 12 18:35:24.059810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-154f48ff-d513-4f1d-bb8c-46fff1491616 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.731788 Jul 12 18:35:24.060706 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 419/879] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:35:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:35:24.071631 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d9839c61-8c59-46a2-862a-8de5e087f0ea tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:24.073417 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d9839c61-8c59-46a2-862a-8de5e087f0ea tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:24.128783 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d9839c61-8c59-46a2-862a-8de5e087f0ea tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:24.135509 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d9839c61-8c59-46a2-862a-8de5e087f0ea tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1240 microversion: 2.1 time: 0.068305 Jul 12 18:35:24.136058 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 461/880] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:24 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:25.152851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-47567c87-0d77-48ea-bbc4-615e4c008965 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:25.153492 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-47567c87-0d77-48ea-bbc4-615e4c008965 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:25.159930 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-47567c87-0d77-48ea-bbc4-615e4c008965 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:25.160420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-47567c87-0d77-48ea-bbc4-615e4c008965 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:25.161165 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-47567c87-0d77-48ea-bbc4-615e4c008965 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:25.161593 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-47567c87-0d77-48ea-bbc4-615e4c008965 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:25.225231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-47567c87-0d77-48ea-bbc4-615e4c008965 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:25.232692 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-47567c87-0d77-48ea-bbc4-615e4c008965 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1244 microversion: 2.1 time: 0.084219 Jul 12 18:35:25.233251 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 420/881] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:25 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1244 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:26.250566 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d762df94-03c7-4819-b761-50b42b163bdf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:26.252871 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-d762df94-03c7-4819-b761-50b42b163bdf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:26.259568 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d762df94-03c7-4819-b761-50b42b163bdf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:26.260009 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d762df94-03c7-4819-b761-50b42b163bdf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:26.260800 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d762df94-03c7-4819-b761-50b42b163bdf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:26.261233 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-d762df94-03c7-4819-b761-50b42b163bdf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:26.326142 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-d762df94-03c7-4819-b761-50b42b163bdf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:26.333631 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d762df94-03c7-4819-b761-50b42b163bdf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1300 microversion: 2.1 time: 0.086996 Jul 12 18:35:26.334196 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 462/882] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:26 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:27.351080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ffc3f8f0-aa7e-4a14-acd5-50a1cf4d2bbb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:27.351793 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ffc3f8f0-aa7e-4a14-acd5-50a1cf4d2bbb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:27.358447 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ffc3f8f0-aa7e-4a14-acd5-50a1cf4d2bbb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:27.358972 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ffc3f8f0-aa7e-4a14-acd5-50a1cf4d2bbb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:27.359728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ffc3f8f0-aa7e-4a14-acd5-50a1cf4d2bbb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:27.360151 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ffc3f8f0-aa7e-4a14-acd5-50a1cf4d2bbb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:27.576396 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ffc3f8f0-aa7e-4a14-acd5-50a1cf4d2bbb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:27.584865 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ffc3f8f0-aa7e-4a14-acd5-50a1cf4d2bbb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1365 microversion: 2.1 time: 0.237652 Jul 12 18:35:27.585464 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 421/883] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:27 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:28.089968 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-88ccd0c6-3b6a-4fa6-8fa5-e6afea1a3a23 req-f3d1bc50-81aa-46db-b9cb-1cb0248a0e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c24894-61e7-4321-a525-49cf1fff7bd8", "tag": "04d5111b-566e-4d14-9dc0-da4b7c138d9c"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:35:28.107805 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-88ccd0c6-3b6a-4fa6-8fa5-e6afea1a3a23 req-f3d1bc50-81aa-46db-b9cb-1cb0248a0e33 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:28.107805 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-88ccd0c6-3b6a-4fa6-8fa5-e6afea1a3a23 req-f3d1bc50-81aa-46db-b9cb-1cb0248a0e33 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:28.120241 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-88ccd0c6-3b6a-4fa6-8fa5-e6afea1a3a23 req-f3d1bc50-81aa-46db-b9cb-1cb0248a0e33 service nova] Creating event network-changed:04d5111b-566e-4d14-9dc0-da4b7c138d9c for instance 93c24894-61e7-4321-a525-49cf1fff7bd8 on hv-cinder-84488 Jul 12 18:35:28.126055 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-88ccd0c6-3b6a-4fa6-8fa5-e6afea1a3a23 req-f3d1bc50-81aa-46db-b9cb-1cb0248a0e33 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041532 Jul 12 18:35:28.127612 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 463/884] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:28.605001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5d003443-9781-4dc7-83c4-6739cb50cc08 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:28.605575 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5d003443-9781-4dc7-83c4-6739cb50cc08 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:28.612672 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d003443-9781-4dc7-83c4-6739cb50cc08 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:28.613115 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d003443-9781-4dc7-83c4-6739cb50cc08 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:28.613873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d003443-9781-4dc7-83c4-6739cb50cc08 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:28.614296 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d003443-9781-4dc7-83c4-6739cb50cc08 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:28.829877 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5d003443-9781-4dc7-83c4-6739cb50cc08 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:28.837393 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5d003443-9781-4dc7-83c4-6739cb50cc08 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1365 microversion: 2.1 time: 0.236306 Jul 12 18:35:28.838100 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 422/885] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:28 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:29.855874 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-37c56df3-e0cc-4448-8f65-170d2bdf083d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:29.856588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-37c56df3-e0cc-4448-8f65-170d2bdf083d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:29.862728 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-37c56df3-e0cc-4448-8f65-170d2bdf083d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:29.863185 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-37c56df3-e0cc-4448-8f65-170d2bdf083d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:29.863948 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-37c56df3-e0cc-4448-8f65-170d2bdf083d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:29.864410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-37c56df3-e0cc-4448-8f65-170d2bdf083d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:29.996250 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-37c56df3-e0cc-4448-8f65-170d2bdf083d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:30.003573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-37c56df3-e0cc-4448-8f65-170d2bdf083d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1365 microversion: 2.1 time: 0.152436 Jul 12 18:35:30.004750 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 464/886] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:29 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:31.021707 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ec57b5bf-1723-460f-953c-b3f7a59d69f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:31.022261 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ec57b5bf-1723-460f-953c-b3f7a59d69f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:31.028752 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec57b5bf-1723-460f-953c-b3f7a59d69f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:31.029192 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec57b5bf-1723-460f-953c-b3f7a59d69f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:31.029943 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec57b5bf-1723-460f-953c-b3f7a59d69f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:31.030374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ec57b5bf-1723-460f-953c-b3f7a59d69f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:31.160319 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ec57b5bf-1723-460f-953c-b3f7a59d69f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:31.167860 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ec57b5bf-1723-460f-953c-b3f7a59d69f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1365 microversion: 2.1 time: 0.150707 Jul 12 18:35:31.168438 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 423/887] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:31 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:32.184190 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-afe9688e-ddec-4a4e-ae01-bccf052a3a4b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:32.185057 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-afe9688e-ddec-4a4e-ae01-bccf052a3a4b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:32.192794 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afe9688e-ddec-4a4e-ae01-bccf052a3a4b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:32.192794 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afe9688e-ddec-4a4e-ae01-bccf052a3a4b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:32.193517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afe9688e-ddec-4a4e-ae01-bccf052a3a4b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:32.193947 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afe9688e-ddec-4a4e-ae01-bccf052a3a4b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:32.328246 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-afe9688e-ddec-4a4e-ae01-bccf052a3a4b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:32.336534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-afe9688e-ddec-4a4e-ae01-bccf052a3a4b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1365 microversion: 2.1 time: 0.156089 Jul 12 18:35:32.337094 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 465/888] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:32 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:33.359127 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f36f7781-eb5f-4f92-8726-d1432c00198e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:33.360033 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f36f7781-eb5f-4f92-8726-d1432c00198e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:33.361981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:33.362667 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:33.368232 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f36f7781-eb5f-4f92-8726-d1432c00198e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:33.368611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f36f7781-eb5f-4f92-8726-d1432c00198e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:33.369644 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f36f7781-eb5f-4f92-8726-d1432c00198e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:33.370074 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f36f7781-eb5f-4f92-8726-d1432c00198e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:33.518047 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f36f7781-eb5f-4f92-8726-d1432c00198e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:33.525987 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f36f7781-eb5f-4f92-8726-d1432c00198e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1365 microversion: 2.1 time: 0.170789 Jul 12 18:35:33.526554 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 424/889] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:33 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:34.233508 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-d64fe6e7-0d44-4c5e-84a0-b17cc1f400a7 req-d066e06a-1697-4c7e-9ffb-ee5ad24e8338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c24894-61e7-4321-a525-49cf1fff7bd8", "name": "network-vif-plugged", "status": "completed", "tag": "04d5111b-566e-4d14-9dc0-da4b7c138d9c"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:35:34.237520 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=6 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:34.242776 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-d64fe6e7-0d44-4c5e-84a0-b17cc1f400a7 req-d066e06a-1697-4c7e-9ffb-ee5ad24e8338 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:34.243211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-d64fe6e7-0d44-4c5e-84a0-b17cc1f400a7 req-d066e06a-1697-4c7e-9ffb-ee5ad24e8338 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:34.254124 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-d64fe6e7-0d44-4c5e-84a0-b17cc1f400a7 req-d066e06a-1697-4c7e-9ffb-ee5ad24e8338 service nova] Creating event network-vif-plugged:04d5111b-566e-4d14-9dc0-da4b7c138d9c for instance 93c24894-61e7-4321-a525-49cf1fff7bd8 on hv-cinder-84488 Jul 12 18:35:34.259468 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-d64fe6e7-0d44-4c5e-84a0-b17cc1f400a7 req-d066e06a-1697-4c7e-9ffb-ee5ad24e8338 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029641 Jul 12 18:35:34.260033 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 466/890] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:34.545860 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-50b82798-7993-44e6-a1df-2ba81490851c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:34.546470 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-50b82798-7993-44e6-a1df-2ba81490851c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:34.553333 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50b82798-7993-44e6-a1df-2ba81490851c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:34.553774 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50b82798-7993-44e6-a1df-2ba81490851c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:34.555172 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50b82798-7993-44e6-a1df-2ba81490851c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:34.555605 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50b82798-7993-44e6-a1df-2ba81490851c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:34.752349 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-50b82798-7993-44e6-a1df-2ba81490851c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:34.764038 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-50b82798-7993-44e6-a1df-2ba81490851c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1365 microversion: 2.1 time: 0.221586 Jul 12 18:35:34.764038 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 425/891] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:34 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:35.781478 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6b1de05b-ea7b-48b0-b561-fdea325909cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:35.782169 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6b1de05b-ea7b-48b0-b561-fdea325909cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:35.784444 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:35.789896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6b1de05b-ea7b-48b0-b561-fdea325909cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:35.790334 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6b1de05b-ea7b-48b0-b561-fdea325909cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:35.791097 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6b1de05b-ea7b-48b0-b561-fdea325909cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:35.791527 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6b1de05b-ea7b-48b0-b561-fdea325909cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:35.795671 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:35.927925 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6b1de05b-ea7b-48b0-b561-fdea325909cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:35.935371 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6b1de05b-ea7b-48b0-b561-fdea325909cf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1365 microversion: 2.1 time: 0.158749 Jul 12 18:35:35.935971 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 467/892] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:35 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:36.953284 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-eb2e53e8-a373-4bd2-a997-97e6131e3fc0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:36.953891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-eb2e53e8-a373-4bd2-a997-97e6131e3fc0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:36.960757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eb2e53e8-a373-4bd2-a997-97e6131e3fc0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:36.961205 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eb2e53e8-a373-4bd2-a997-97e6131e3fc0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:36.961963 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eb2e53e8-a373-4bd2-a997-97e6131e3fc0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:36.962428 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eb2e53e8-a373-4bd2-a997-97e6131e3fc0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:36.965357 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=97 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:37.101379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-eb2e53e8-a373-4bd2-a997-97e6131e3fc0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:37.108816 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-eb2e53e8-a373-4bd2-a997-97e6131e3fc0 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1556 microversion: 2.1 time: 0.159602 Jul 12 18:35:37.109366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 426/893] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:36 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:37.126054 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4f96202f-ef4f-496d-be89-a18496b5b604 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:37.126584 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4f96202f-ef4f-496d-be89-a18496b5b604 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:37.134599 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f96202f-ef4f-496d-be89-a18496b5b604 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:37.135082 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f96202f-ef4f-496d-be89-a18496b5b604 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:37.140766 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f96202f-ef4f-496d-be89-a18496b5b604 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:37.140766 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f96202f-ef4f-496d-be89-a18496b5b604 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:37.213435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4f96202f-ef4f-496d-be89-a18496b5b604 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091836 Jul 12 18:35:37.214024 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 468/894] 10.222.0.47 () {58 vars in 1274 bytes} [Tue Jul 12 18:35:37 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:38.216854 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-b8e1cb61-b466-4b78-b47e-c99d2430e07b req-75d7bd98-9f54-499b-a39c-b91582d5fe74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c24894-61e7-4321-a525-49cf1fff7bd8", "tag": "04d5111b-566e-4d14-9dc0-da4b7c138d9c"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:35:38.220771 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:38.227075 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-b8e1cb61-b466-4b78-b47e-c99d2430e07b req-75d7bd98-9f54-499b-a39c-b91582d5fe74 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:38.227515 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-b8e1cb61-b466-4b78-b47e-c99d2430e07b req-75d7bd98-9f54-499b-a39c-b91582d5fe74 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:38.238516 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-b8e1cb61-b466-4b78-b47e-c99d2430e07b req-75d7bd98-9f54-499b-a39c-b91582d5fe74 service nova] Creating event network-changed:04d5111b-566e-4d14-9dc0-da4b7c138d9c for instance 93c24894-61e7-4321-a525-49cf1fff7bd8 on hv-cinder-84488 Jul 12 18:35:38.243619 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-b8e1cb61-b466-4b78-b47e-c99d2430e07b req-75d7bd98-9f54-499b-a39c-b91582d5fe74 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030390 Jul 12 18:35:38.245832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 427/895] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:56.111494 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=9 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:56.112325 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=3 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:56.116193 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-84ddc8c3-f116-4cd6-9cc7-42ada2c604f6 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:56.116721 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-84ddc8c3-f116-4cd6-9cc7-42ada2c604f6 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:56.123614 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-84ddc8c3-f116-4cd6-9cc7-42ada2c604f6 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:56.124072 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-84ddc8c3-f116-4cd6-9cc7-42ada2c604f6 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:56.124891 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-84ddc8c3-f116-4cd6-9cc7-42ada2c604f6 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:56.125329 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-84ddc8c3-f116-4cd6-9cc7-42ada2c604f6 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:56.151090 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-84ddc8c3-f116-4cd6-9cc7-42ada2c604f6 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:35:56.423256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-84ddc8c3-f116-4cd6-9cc7-42ada2c604f6 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 204 len: 0 microversion: 2.1 time: 0.312877 Jul 12 18:35:56.423847 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 469/896] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:35:56 2022] DELETE /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:35:56.429964 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=7 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:35:56.434703 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4f4831b6-6d10-467c-8565-68980aaf4550 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:56.439486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4f4831b6-6d10-467c-8565-68980aaf4550 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:56.442562 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f4831b6-6d10-467c-8565-68980aaf4550 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:56.443013 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f4831b6-6d10-467c-8565-68980aaf4550 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:56.443784 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f4831b6-6d10-467c-8565-68980aaf4550 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:56.444214 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f4831b6-6d10-467c-8565-68980aaf4550 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:56.579230 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4f4831b6-6d10-467c-8565-68980aaf4550 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:56.586777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4f4831b6-6d10-467c-8565-68980aaf4550 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1576 microversion: 2.1 time: 0.158383 Jul 12 18:35:56.587468 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 428/897] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:56 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:57.604671 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fa0ee39f-2cdb-48e2-b4c1-7446c166f598 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:57.605391 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fa0ee39f-2cdb-48e2-b4c1-7446c166f598 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:57.612229 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fa0ee39f-2cdb-48e2-b4c1-7446c166f598 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:57.612701 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fa0ee39f-2cdb-48e2-b4c1-7446c166f598 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:57.613460 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fa0ee39f-2cdb-48e2-b4c1-7446c166f598 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:57.613886 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fa0ee39f-2cdb-48e2-b4c1-7446c166f598 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:57.755360 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fa0ee39f-2cdb-48e2-b4c1-7446c166f598 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:57.765262 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fa0ee39f-2cdb-48e2-b4c1-7446c166f598 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1576 microversion: 2.1 time: 0.164793 Jul 12 18:35:57.765896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 470/898] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:57 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:35:58.783197 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-99b5320c-fcdb-495b-b296-efd6be473a10 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:58.783861 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-99b5320c-fcdb-495b-b296-efd6be473a10 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:58.791161 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-99b5320c-fcdb-495b-b296-efd6be473a10 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:58.791641 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-99b5320c-fcdb-495b-b296-efd6be473a10 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:58.792473 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-99b5320c-fcdb-495b-b296-efd6be473a10 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:58.792912 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-99b5320c-fcdb-495b-b296-efd6be473a10 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:58.890630 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-99b5320c-fcdb-495b-b296-efd6be473a10 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:35:58.898823 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-99b5320c-fcdb-495b-b296-efd6be473a10 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1510 microversion: 2.1 time: 0.120083 Jul 12 18:35:58.899412 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 429/899] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:58 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1510 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:35:59.236609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-f970c229-497d-48d4-81f2-dd2d1c5c62f1 req-4460a24c-b2ec-4c2f-8f76-5c48d636d881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2", "name": "network-vif-deleted", "tag": "7b905735-73a2-4639-ba81-f50913467d0a"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:35:59.251347 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-f970c229-497d-48d4-81f2-dd2d1c5c62f1 req-4460a24c-b2ec-4c2f-8f76-5c48d636d881 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:59.252037 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-f970c229-497d-48d4-81f2-dd2d1c5c62f1 req-4460a24c-b2ec-4c2f-8f76-5c48d636d881 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:59.271092 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-f970c229-497d-48d4-81f2-dd2d1c5c62f1 req-4460a24c-b2ec-4c2f-8f76-5c48d636d881 service nova] Creating event network-vif-deleted:7b905735-73a2-4639-ba81-f50913467d0a for instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 on hv-cinder-84488 Jul 12 18:35:59.276846 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-f970c229-497d-48d4-81f2-dd2d1c5c62f1 req-4460a24c-b2ec-4c2f-8f76-5c48d636d881 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139608 Jul 12 18:35:59.277766 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 471/900] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:35:59.917144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-43a76ce2-ea20-4f2e-82e0-c97f0a488317 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:35:59.917838 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-43a76ce2-ea20-4f2e-82e0-c97f0a488317 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:35:59.928170 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-43a76ce2-ea20-4f2e-82e0-c97f0a488317 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:59.928677 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-43a76ce2-ea20-4f2e-82e0-c97f0a488317 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:59.929630 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-43a76ce2-ea20-4f2e-82e0-c97f0a488317 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:59.930059 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-43a76ce2-ea20-4f2e-82e0-c97f0a488317 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:59.965506 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-43a76ce2-ea20-4f2e-82e0-c97f0a488317 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:35:59.965949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-43a76ce2-ea20-4f2e-82e0-c97f0a488317 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:35:59.966917 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-43a76ce2-ea20-4f2e-82e0-c97f0a488317 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lazy-loading 'fault' on Instance uuid 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:36:00.011986 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-43a76ce2-ea20-4f2e-82e0-c97f0a488317 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:00.020216 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-43a76ce2-ea20-4f2e-82e0-c97f0a488317 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 200 len: 1231 microversion: 2.1 time: 0.107138 Jul 12 18:36:00.021193 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 430/901] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:35:59 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:01.038467 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a81cbca5-bf29-475c-b176-adb7e7aa3bc2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:01.039169 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a81cbca5-bf29-475c-b176-adb7e7aa3bc2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:01.046497 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a81cbca5-bf29-475c-b176-adb7e7aa3bc2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:01.046967 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a81cbca5-bf29-475c-b176-adb7e7aa3bc2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:01.047752 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a81cbca5-bf29-475c-b176-adb7e7aa3bc2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:01.048161 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a81cbca5-bf29-475c-b176-adb7e7aa3bc2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:01.062525 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-a81cbca5-bf29-475c-b176-adb7e7aa3bc2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] HTTP exception thrown: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a81cbca5-bf29-475c-b176-adb7e7aa3bc2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Request method failure captured: Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 HTTP/1.1 Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb5g-VR3KwwJyH66d8kwPDNjs-m_IjFONcC1Tsci-uR-SKzfdiJPUuh5LNpwN1QTziJ6zpflWI_6Dw-sOicuPFf9e0ORcKKOuc66Jf4YqquAbaVCc19qP8U-BOySfON5Vx17tAuxVqmxwfsr8obauKifbLh_jOdMwOkThPvo4iRxF9I Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 447abd08211d49f9b503130ac5c380b7 Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:36:01.064194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_447abd08211d49f9b503130ac5c380b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 447abd08211d49f9b503130ac5c380b7 Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-TestVolumeBootPattern-2076851829-project Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 7a647aab17cf4345800cd9072a7820c0 Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-TestVolumeBootPattern-2076851829-project Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:36:01.065709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': '7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2'} Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:36:01.066556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:36:01.068410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:36:01.069844 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a81cbca5-bf29-475c-b176-adb7e7aa3bc2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Returning 404 to user: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:36:01.069844 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a81cbca5-bf29-475c-b176-adb7e7aa3bc2 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 404 len: 111 microversion: 2.1 time: 0.031932 Jul 12 18:36:01.069844 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 472/902] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:01 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:36:01.164220 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1780017669", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1121766819", "security_groups": [{"name": "tempest-secgroup-smoke-93854513"}], "block_device_mapping_v2": [{"uuid": "eec23b48-1f45-466a-904a-60ee0c03041c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "337a86a6-f7ab-43ec-ae8f-46aa53a87569"}]}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:01.281190 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] validate_networks() for [('337a86a6-f7ab-43ec-ae8f-46aa53a87569', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:36:01.701209 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:36:01.701629 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:36:01.702195 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:36:01.702598 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:36:01.703000 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:36:01.712953 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:01.713394 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:01.714189 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:01.714609 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:01.733658 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Getting quotas for project 447abd08211d49f9b503130ac5c380b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:36:01.738343 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Getting quotas for user 7a647aab17cf4345800cd9072a7820c0 and project 447abd08211d49f9b503130ac5c380b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:36:01.798461 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:36:01.800813 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eec23b48-1f45-466a-904a-60ee0c03041c',volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:36:02.221108 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2eec3f1a-ff94-46b6-94c6-1e92b485a907 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.060576 Jul 12 18:36:02.222463 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 431/903] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:36:01 2022] POST /compute/v2.1/servers => generated 404 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:36:02.234314 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-26fa21be-30e6-4b33-9a56-f186c7bec562 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:02.235324 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-26fa21be-30e6-4b33-9a56-f186c7bec562 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:02.308943 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-26fa21be-30e6-4b33-9a56-f186c7bec562 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:02.318787 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-26fa21be-30e6-4b33-9a56-f186c7bec562 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1095 microversion: 2.1 time: 0.089893 Jul 12 18:36:02.319804 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 473/904] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:02 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1095 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:03.335773 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c77d894a-5329-4edf-b40d-8809a85f78ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:03.336436 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c77d894a-5329-4edf-b40d-8809a85f78ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:03.343374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c77d894a-5329-4edf-b40d-8809a85f78ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:03.343818 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c77d894a-5329-4edf-b40d-8809a85f78ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:03.344621 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c77d894a-5329-4edf-b40d-8809a85f78ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:03.345050 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c77d894a-5329-4edf-b40d-8809a85f78ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:03.410359 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c77d894a-5329-4edf-b40d-8809a85f78ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:03.418340 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c77d894a-5329-4edf-b40d-8809a85f78ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1145 microversion: 2.1 time: 0.086470 Jul 12 18:36:03.418931 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 432/905] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:03 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:04.435354 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7e1536ad-0e1b-4975-a457-eaaa35f72201 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:04.436466 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7e1536ad-0e1b-4975-a457-eaaa35f72201 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:04.443964 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7e1536ad-0e1b-4975-a457-eaaa35f72201 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:04.444552 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7e1536ad-0e1b-4975-a457-eaaa35f72201 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:04.445533 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7e1536ad-0e1b-4975-a457-eaaa35f72201 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:04.446173 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7e1536ad-0e1b-4975-a457-eaaa35f72201 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:04.515331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7e1536ad-0e1b-4975-a457-eaaa35f72201 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:04.523307 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7e1536ad-0e1b-4975-a457-eaaa35f72201 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1201 microversion: 2.1 time: 0.091867 Jul 12 18:36:04.528988 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 474/906] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:04 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1201 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:05.542562 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9be09f85-3e58-4008-8dab-fe5848a3bc3f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:05.543924 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9be09f85-3e58-4008-8dab-fe5848a3bc3f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:05.550705 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9be09f85-3e58-4008-8dab-fe5848a3bc3f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:05.551268 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9be09f85-3e58-4008-8dab-fe5848a3bc3f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:05.552148 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9be09f85-3e58-4008-8dab-fe5848a3bc3f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:05.552697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9be09f85-3e58-4008-8dab-fe5848a3bc3f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:05.755674 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9be09f85-3e58-4008-8dab-fe5848a3bc3f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:05.763563 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9be09f85-3e58-4008-8dab-fe5848a3bc3f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1277 microversion: 2.1 time: 0.225297 Jul 12 18:36:05.764603 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 433/907] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:05 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:06.255765 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-69269a4c-6bc1-4ae0-9679-60e5255a843b req-13288c26-740f-4797-b05b-7ec6b87a9c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1731378e-059e-427c-98c5-d580418675a8", "tag": "69273601-4b08-4ca9-9e53-e3ba1af0d8dd"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:06.266117 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-69269a4c-6bc1-4ae0-9679-60e5255a843b req-13288c26-740f-4797-b05b-7ec6b87a9c63 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:06.267003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-69269a4c-6bc1-4ae0-9679-60e5255a843b req-13288c26-740f-4797-b05b-7ec6b87a9c63 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:06.285360 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-69269a4c-6bc1-4ae0-9679-60e5255a843b req-13288c26-740f-4797-b05b-7ec6b87a9c63 service nova] Creating event network-changed:69273601-4b08-4ca9-9e53-e3ba1af0d8dd for instance 1731378e-059e-427c-98c5-d580418675a8 on hv-cinder-84488 Jul 12 18:36:06.290427 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-69269a4c-6bc1-4ae0-9679-60e5255a843b req-13288c26-740f-4797-b05b-7ec6b87a9c63 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038349 Jul 12 18:36:06.291032 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 475/908] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:36:06.781802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-18cc7aee-885c-4059-9bd8-03fb85e83866 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:06.782420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-18cc7aee-885c-4059-9bd8-03fb85e83866 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:06.788643 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-18cc7aee-885c-4059-9bd8-03fb85e83866 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:06.789086 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-18cc7aee-885c-4059-9bd8-03fb85e83866 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:06.789855 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-18cc7aee-885c-4059-9bd8-03fb85e83866 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:06.790282 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-18cc7aee-885c-4059-9bd8-03fb85e83866 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:07.006869 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-18cc7aee-885c-4059-9bd8-03fb85e83866 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:07.014854 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-18cc7aee-885c-4059-9bd8-03fb85e83866 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1265 microversion: 2.1 time: 0.237523 Jul 12 18:36:07.015426 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 434/909] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:06 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:08.033856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ba2c7d61-ce39-4642-99a5-04c823fe59ad tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:08.034552 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ba2c7d61-ce39-4642-99a5-04c823fe59ad tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:08.040876 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba2c7d61-ce39-4642-99a5-04c823fe59ad tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:08.041323 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba2c7d61-ce39-4642-99a5-04c823fe59ad tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:08.042080 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba2c7d61-ce39-4642-99a5-04c823fe59ad tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:08.042514 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ba2c7d61-ce39-4642-99a5-04c823fe59ad tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:08.178812 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ba2c7d61-ce39-4642-99a5-04c823fe59ad tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:08.186273 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ba2c7d61-ce39-4642-99a5-04c823fe59ad tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1265 microversion: 2.1 time: 0.157984 Jul 12 18:36:08.186837 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 476/910] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:08 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:09.203396 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8c3f0707-79da-45b4-b272-68702dfa05ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:09.203960 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8c3f0707-79da-45b4-b272-68702dfa05ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:09.211115 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8c3f0707-79da-45b4-b272-68702dfa05ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:09.211592 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8c3f0707-79da-45b4-b272-68702dfa05ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:09.212392 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8c3f0707-79da-45b4-b272-68702dfa05ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:09.212826 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8c3f0707-79da-45b4-b272-68702dfa05ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:09.344892 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8c3f0707-79da-45b4-b272-68702dfa05ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:09.352412 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8c3f0707-79da-45b4-b272-68702dfa05ac tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1265 microversion: 2.1 time: 0.153340 Jul 12 18:36:09.352973 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 435/911] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:09 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:10.369142 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7bec628e-f379-4bc2-87d6-ec2bdb5d5a0c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:10.369770 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7bec628e-f379-4bc2-87d6-ec2bdb5d5a0c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:10.377256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7bec628e-f379-4bc2-87d6-ec2bdb5d5a0c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:10.377703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7bec628e-f379-4bc2-87d6-ec2bdb5d5a0c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:10.378459 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7bec628e-f379-4bc2-87d6-ec2bdb5d5a0c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:10.379006 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7bec628e-f379-4bc2-87d6-ec2bdb5d5a0c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:10.515535 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7bec628e-f379-4bc2-87d6-ec2bdb5d5a0c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:10.523064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7bec628e-f379-4bc2-87d6-ec2bdb5d5a0c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1265 microversion: 2.1 time: 0.157805 Jul 12 18:36:10.523630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 477/912] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:10 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:10.601152 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-88ca4473-4123-45dc-bc84-80aed3996a00 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:10.601735 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-88ca4473-4123-45dc-bc84-80aed3996a00 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:10.608947 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-88ca4473-4123-45dc-bc84-80aed3996a00 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:10.609389 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-88ca4473-4123-45dc-bc84-80aed3996a00 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:10.610160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-88ca4473-4123-45dc-bc84-80aed3996a00 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:10.610590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-88ca4473-4123-45dc-bc84-80aed3996a00 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:10.636692 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-88ca4473-4123-45dc-bc84-80aed3996a00 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/ips" status: 200 len: 149 microversion: 2.1 time: 0.039291 Jul 12 18:36:10.637270 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 436/913] 10.222.0.47 () {58 vars in 1247 bytes} [Tue Jul 12 18:36:10 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:36:11.539616 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-379e2542-da9c-4fbf-b29a-0af5f3868bea tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:11.540221 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-379e2542-da9c-4fbf-b29a-0af5f3868bea tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:11.546798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-379e2542-da9c-4fbf-b29a-0af5f3868bea tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:11.547317 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-379e2542-da9c-4fbf-b29a-0af5f3868bea tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:11.552769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-379e2542-da9c-4fbf-b29a-0af5f3868bea tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:11.552769 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-379e2542-da9c-4fbf-b29a-0af5f3868bea tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:11.686468 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-379e2542-da9c-4fbf-b29a-0af5f3868bea tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:11.693805 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-379e2542-da9c-4fbf-b29a-0af5f3868bea tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1265 microversion: 2.1 time: 0.158270 Jul 12 18:36:11.694368 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 478/914] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:11 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:12.369006 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4c54a64f-c21a-4eda-878e-6da19cddf524 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aceb0d51-03f0-48e7-90de-632c94df2568"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:12.370375 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4c54a64f-c21a-4eda-878e-6da19cddf524 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:12.372687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:12.374081 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:12.379296 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c54a64f-c21a-4eda-878e-6da19cddf524 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:12.379739 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c54a64f-c21a-4eda-878e-6da19cddf524 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:12.380627 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c54a64f-c21a-4eda-878e-6da19cddf524 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:12.381062 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4c54a64f-c21a-4eda-878e-6da19cddf524 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:12.711470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f3f5675c-7991-40a2-9075-783c16ab36e0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:12.712070 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f3f5675c-7991-40a2-9075-783c16ab36e0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:12.714041 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:12.719371 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f3f5675c-7991-40a2-9075-783c16ab36e0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:12.720442 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f3f5675c-7991-40a2-9075-783c16ab36e0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:12.721519 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f3f5675c-7991-40a2-9075-783c16ab36e0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:12.721612 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f3f5675c-7991-40a2-9075-783c16ab36e0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:12.859647 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f3f5675c-7991-40a2-9075-783c16ab36e0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:12.867209 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f3f5675c-7991-40a2-9075-783c16ab36e0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1265 microversion: 2.1 time: 0.159821 Jul 12 18:36:12.871673 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 479/915] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:12 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:36:13.833670 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4c54a64f-c21a-4eda-878e-6da19cddf524 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.468335 Jul 12 18:36:13.834247 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 437/916] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:36:12 2022] POST /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments => generated 194 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:36:13.885000 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-db57f56c-4898-4b44-92e8-40bd2de7c346 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:13.885619 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-db57f56c-4898-4b44-92e8-40bd2de7c346 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:13.892551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db57f56c-4898-4b44-92e8-40bd2de7c346 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:13.894026 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db57f56c-4898-4b44-92e8-40bd2de7c346 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:13.894026 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db57f56c-4898-4b44-92e8-40bd2de7c346 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:13.894359 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-db57f56c-4898-4b44-92e8-40bd2de7c346 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:14.033081 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-db57f56c-4898-4b44-92e8-40bd2de7c346 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:14.040600 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-db57f56c-4898-4b44-92e8-40bd2de7c346 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1265 microversion: 2.1 time: 0.159692 Jul 12 18:36:14.041166 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 480/917] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:13 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:15.059086 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0a828249-1b0b-426f-8785-bbdc2c289dcb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:15.059774 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0a828249-1b0b-426f-8785-bbdc2c289dcb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:15.067059 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a828249-1b0b-426f-8785-bbdc2c289dcb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:15.067498 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a828249-1b0b-426f-8785-bbdc2c289dcb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:15.068267 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a828249-1b0b-426f-8785-bbdc2c289dcb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:15.068744 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a828249-1b0b-426f-8785-bbdc2c289dcb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:15.205178 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0a828249-1b0b-426f-8785-bbdc2c289dcb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:15.212807 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0a828249-1b0b-426f-8785-bbdc2c289dcb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1265 microversion: 2.1 time: 0.158340 Jul 12 18:36:15.213368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 438/918] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:15 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:36:16.230275 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cd9ce028-91f1-4663-b341-c091b6904eef tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:16.230883 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-cd9ce028-91f1-4663-b341-c091b6904eef tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:16.238131 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd9ce028-91f1-4663-b341-c091b6904eef tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:16.238569 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd9ce028-91f1-4663-b341-c091b6904eef tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:16.239394 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd9ce028-91f1-4663-b341-c091b6904eef tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:16.239742 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd9ce028-91f1-4663-b341-c091b6904eef tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:16.388160 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-cd9ce028-91f1-4663-b341-c091b6904eef tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:16.396431 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-cd9ce028-91f1-4663-b341-c091b6904eef tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1265 microversion: 2.1 time: 0.169981 Jul 12 18:36:16.397010 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 481/919] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:16 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:16.541759 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-ac320eb0-13d5-4e10-8229-01f2ca616946 req-3e096812-9bed-4d5c-9e00-908f2d987f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1731378e-059e-427c-98c5-d580418675a8", "name": "network-vif-plugged", "status": "completed", "tag": "69273601-4b08-4ca9-9e53-e3ba1af0d8dd"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:16.549978 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-ac320eb0-13d5-4e10-8229-01f2ca616946 req-3e096812-9bed-4d5c-9e00-908f2d987f84 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:16.550418 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-ac320eb0-13d5-4e10-8229-01f2ca616946 req-3e096812-9bed-4d5c-9e00-908f2d987f84 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:16.561390 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-ac320eb0-13d5-4e10-8229-01f2ca616946 req-3e096812-9bed-4d5c-9e00-908f2d987f84 service nova] Creating event network-vif-plugged:69273601-4b08-4ca9-9e53-e3ba1af0d8dd for instance 1731378e-059e-427c-98c5-d580418675a8 on hv-cinder-84488 Jul 12 18:36:16.566591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-ac320eb0-13d5-4e10-8229-01f2ca616946 req-3e096812-9bed-4d5c-9e00-908f2d987f84 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090041 Jul 12 18:36:16.567248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 439/920] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:36:17.412813 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-905431ba-0b09-493c-8f7c-5a5ea10f633a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:17.413448 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-905431ba-0b09-493c-8f7c-5a5ea10f633a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:17.419946 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-905431ba-0b09-493c-8f7c-5a5ea10f633a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:17.420422 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-905431ba-0b09-493c-8f7c-5a5ea10f633a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:17.421178 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-905431ba-0b09-493c-8f7c-5a5ea10f633a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:17.421607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-905431ba-0b09-493c-8f7c-5a5ea10f633a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:17.552244 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-905431ba-0b09-493c-8f7c-5a5ea10f633a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:17.559815 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-905431ba-0b09-493c-8f7c-5a5ea10f633a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1265 microversion: 2.1 time: 0.151477 Jul 12 18:36:17.560375 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 482/921] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:17 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:18.577892 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-249d7b25-b8ff-4830-ab04-61cba33ef773 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:18.578591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-249d7b25-b8ff-4830-ab04-61cba33ef773 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:18.585345 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-249d7b25-b8ff-4830-ab04-61cba33ef773 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:18.585797 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-249d7b25-b8ff-4830-ab04-61cba33ef773 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:18.586568 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-249d7b25-b8ff-4830-ab04-61cba33ef773 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:18.587001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-249d7b25-b8ff-4830-ab04-61cba33ef773 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:18.723895 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-249d7b25-b8ff-4830-ab04-61cba33ef773 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:18.731280 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-249d7b25-b8ff-4830-ab04-61cba33ef773 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1453 microversion: 2.1 time: 0.158063 Jul 12 18:36:18.731851 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 440/922] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:18 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:18.748226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7efdb486-7dee-4ca4-89f0-5a49cd9e9f9b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:18.748886 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7efdb486-7dee-4ca4-89f0-5a49cd9e9f9b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:18.755598 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7efdb486-7dee-4ca4-89f0-5a49cd9e9f9b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:18.756043 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7efdb486-7dee-4ca4-89f0-5a49cd9e9f9b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:18.756826 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7efdb486-7dee-4ca4-89f0-5a49cd9e9f9b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:18.757253 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7efdb486-7dee-4ca4-89f0-5a49cd9e9f9b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:18.892936 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7efdb486-7dee-4ca4-89f0-5a49cd9e9f9b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:18.901673 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7efdb486-7dee-4ca4-89f0-5a49cd9e9f9b tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1453 microversion: 2.1 time: 0.157557 Jul 12 18:36:18.902238 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 483/923] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:18 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:21.045141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-0c729b5e-d247-4d1e-95a1-4953d92ab8ea req-8de462d5-26a6-4423-abf8-73ae2187fe64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1731378e-059e-427c-98c5-d580418675a8", "tag": "69273601-4b08-4ca9-9e53-e3ba1af0d8dd"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:21.053282 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-0c729b5e-d247-4d1e-95a1-4953d92ab8ea req-8de462d5-26a6-4423-abf8-73ae2187fe64 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:21.053629 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-0c729b5e-d247-4d1e-95a1-4953d92ab8ea req-8de462d5-26a6-4423-abf8-73ae2187fe64 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:21.064833 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-0c729b5e-d247-4d1e-95a1-4953d92ab8ea req-8de462d5-26a6-4423-abf8-73ae2187fe64 service nova] Creating event network-changed:69273601-4b08-4ca9-9e53-e3ba1af0d8dd for instance 1731378e-059e-427c-98c5-d580418675a8 on hv-cinder-84488 Jul 12 18:36:21.070377 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-0c729b5e-d247-4d1e-95a1-4953d92ab8ea req-8de462d5-26a6-4423-abf8-73ae2187fe64 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092741 Jul 12 18:36:21.071186 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 441/924] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:36:21.371780 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cedefff8-f9b6-41b3-a367-f2b91b7ca18b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aceb0d51-03f0-48e7-90de-632c94df2568"}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:21.372897 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-cedefff8-f9b6-41b3-a367-f2b91b7ca18b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:21.379945 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cedefff8-f9b6-41b3-a367-f2b91b7ca18b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:21.380424 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cedefff8-f9b6-41b3-a367-f2b91b7ca18b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:21.381279 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cedefff8-f9b6-41b3-a367-f2b91b7ca18b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:21.381718 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cedefff8-f9b6-41b3-a367-f2b91b7ca18b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:21.476195 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-cedefff8-f9b6-41b3-a367-f2b91b7ca18b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Invalid volume: volume aceb0d51-03f0-48e7-90de-632c94df2568 is already attached to instances: 93c24894-61e7-4321-a525-49cf1fff7bd8 Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cedefff8-f9b6-41b3-a367-f2b91b7ca18b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: POST /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments HTTP/1.1 Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 74 Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:36:21.477958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {"volumeAttachment": {"volumeId": "aceb0d51-03f0-48e7-90de-632c94df2568"}} Jul 12 18:36:21.479506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Invalid volume: volume aceb0d51-03f0-48e7-90de-632c94df2568 is already attached to instances: 93c24894-61e7-4321-a525-49cf1fff7bd8 Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'server_id': '93c24894-61e7-4321-a525-49cf1fff7bd8', 'body': {'volumeAttachment': {'volumeId': 'aceb0d51-03f0-48e7-90de-632c94df2568'}}} Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aceb0d51-03f0-48e7-90de-632c94df2568 is already attached to instances: 93c24894-61e7-4321-a525-49cf1fff7bd8 Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:36:21.485650 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aceb0d51-03f0-48e7-90de-632c94df2568 is already attached to instances: 93c24894-61e7-4321-a525-49cf1fff7bd8 Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:36:21.487098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:36:21.488688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:36:21.488688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:36:21.488688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:36:21.488688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aceb0d51-03f0-48e7-90de-632c94df2568 is already attached to instances: 93c24894-61e7-4321-a525-49cf1fff7bd8 Jul 12 18:36:21.488688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:36:21.488688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cedefff8-f9b6-41b3-a367-f2b91b7ca18b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 400 to user: Invalid volume: volume aceb0d51-03f0-48e7-90de-632c94df2568 is already attached to instances: 93c24894-61e7-4321-a525-49cf1fff7bd8 {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:36:21.488688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-cedefff8-f9b6-41b3-a367-f2b91b7ca18b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111996 Jul 12 18:36:21.488688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 484/925] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:36:21 2022] POST /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:36:21.548054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6a89b1ea-226f-402d-aff9-adc87a2ef6be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:21.548665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6a89b1ea-226f-402d-aff9-adc87a2ef6be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:21.555625 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a89b1ea-226f-402d-aff9-adc87a2ef6be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:21.556078 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a89b1ea-226f-402d-aff9-adc87a2ef6be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:21.557177 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a89b1ea-226f-402d-aff9-adc87a2ef6be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:21.557662 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a89b1ea-226f-402d-aff9-adc87a2ef6be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:21.649359 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-6a89b1ea-226f-402d-aff9-adc87a2ef6be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lazy-loading 'services' on Instance uuid 93c24894-61e7-4321-a525-49cf1fff7bd8 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:36:21.868780 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6a89b1ea-226f-402d-aff9-adc87a2ef6be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments/aceb0d51-03f0-48e7-90de-632c94df2568" status: 202 len: 0 microversion: 2.1 time: 0.324287 Jul 12 18:36:21.873153 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 442/926] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:36:21 2022] DELETE /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments/aceb0d51-03f0-48e7-90de-632c94df2568 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:36:21.878421 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-23dd2fa1-18f4-4177-97b8-6d5160285233 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:21.879717 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-23dd2fa1-18f4-4177-97b8-6d5160285233 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:21.886474 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-23dd2fa1-18f4-4177-97b8-6d5160285233 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:21.887009 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-23dd2fa1-18f4-4177-97b8-6d5160285233 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:21.887819 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-23dd2fa1-18f4-4177-97b8-6d5160285233 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:21.888238 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-23dd2fa1-18f4-4177-97b8-6d5160285233 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:21.920474 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-23dd2fa1-18f4-4177-97b8-6d5160285233 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045942 Jul 12 18:36:21.921047 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 485/927] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:36:21 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:36:22.934316 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f0ea3a66-c3ba-4704-aed4-885b599819f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:22.935368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f0ea3a66-c3ba-4704-aed4-885b599819f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:22.941939 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0ea3a66-c3ba-4704-aed4-885b599819f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:22.942523 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0ea3a66-c3ba-4704-aed4-885b599819f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:22.943219 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0ea3a66-c3ba-4704-aed4-885b599819f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:22.943917 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0ea3a66-c3ba-4704-aed4-885b599819f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:22.975276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f0ea3a66-c3ba-4704-aed4-885b599819f1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045868 Jul 12 18:36:22.975845 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 443/928] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:36:22 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:36:23.987389 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b5b6202e-1605-4bcd-8880-80a01d1e7a88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:23.988318 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b5b6202e-1605-4bcd-8880-80a01d1e7a88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:23.994383 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b5b6202e-1605-4bcd-8880-80a01d1e7a88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:23.994834 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b5b6202e-1605-4bcd-8880-80a01d1e7a88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:23.995843 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b5b6202e-1605-4bcd-8880-80a01d1e7a88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:23.996275 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b5b6202e-1605-4bcd-8880-80a01d1e7a88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:24.020835 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:24.024892 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b5b6202e-1605-4bcd-8880-80a01d1e7a88 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041651 Jul 12 18:36:24.025441 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 486/929] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:36:23 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 18:36:24.081404 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f9c18f49-0ab8-463c-b24a-5e9cfd6329ce tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:24.081929 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f9c18f49-0ab8-463c-b24a-5e9cfd6329ce tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:24.089067 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c18f49-0ab8-463c-b24a-5e9cfd6329ce tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:24.089509 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c18f49-0ab8-463c-b24a-5e9cfd6329ce tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:24.090271 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c18f49-0ab8-463c-b24a-5e9cfd6329ce tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:24.090695 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c18f49-0ab8-463c-b24a-5e9cfd6329ce tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:24.109510 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:24.116784 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f9c18f49-0ab8-463c-b24a-5e9cfd6329ce tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:36:24.531982 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f9c18f49-0ab8-463c-b24a-5e9cfd6329ce tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 204 len: 0 microversion: 2.1 time: 0.454120 Jul 12 18:36:24.532612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 444/930] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:36:24 2022] DELETE /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:36:24.542010 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-51b55e1d-0b1c-4496-8e85-a6137690c0fe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:24.544392 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-51b55e1d-0b1c-4496-8e85-a6137690c0fe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:24.549065 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51b55e1d-0b1c-4496-8e85-a6137690c0fe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:24.549508 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51b55e1d-0b1c-4496-8e85-a6137690c0fe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:24.550352 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51b55e1d-0b1c-4496-8e85-a6137690c0fe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:24.550774 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-51b55e1d-0b1c-4496-8e85-a6137690c0fe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:24.686505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-51b55e1d-0b1c-4496-8e85-a6137690c0fe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:24.694086 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-51b55e1d-0b1c-4496-8e85-a6137690c0fe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1679 microversion: 2.1 time: 0.156522 Jul 12 18:36:24.694648 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 487/931] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:24 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:25.712567 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-77293360-fd2d-4ee7-946b-f3fed773b7a5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:25.713169 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-77293360-fd2d-4ee7-946b-f3fed773b7a5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:25.719677 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77293360-fd2d-4ee7-946b-f3fed773b7a5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:25.720115 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77293360-fd2d-4ee7-946b-f3fed773b7a5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:25.720904 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77293360-fd2d-4ee7-946b-f3fed773b7a5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:25.721329 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77293360-fd2d-4ee7-946b-f3fed773b7a5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:25.852273 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-77293360-fd2d-4ee7-946b-f3fed773b7a5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:25.859910 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-77293360-fd2d-4ee7-946b-f3fed773b7a5 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1679 microversion: 2.1 time: 0.152222 Jul 12 18:36:25.860488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 445/932] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:25 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:26.879603 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fbab47dc-4726-4545-90ca-2e2e70d150e1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:26.879603 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fbab47dc-4726-4545-90ca-2e2e70d150e1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:26.881548 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:26.886708 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbab47dc-4726-4545-90ca-2e2e70d150e1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:26.887156 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbab47dc-4726-4545-90ca-2e2e70d150e1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:26.887922 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbab47dc-4726-4545-90ca-2e2e70d150e1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:26.888397 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbab47dc-4726-4545-90ca-2e2e70d150e1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:26.955781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fbab47dc-4726-4545-90ca-2e2e70d150e1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:26.965385 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fbab47dc-4726-4545-90ca-2e2e70d150e1 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1612 microversion: 2.1 time: 0.091501 Jul 12 18:36:26.965999 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 488/933] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:26 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1612 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:27.156770 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-715d562b-9310-46e9-ade7-267cefb19b71 req-2b8c8894-dc7c-45d9-aa05-1298dab7f2bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c24894-61e7-4321-a525-49cf1fff7bd8", "name": "network-vif-deleted", "tag": "04d5111b-566e-4d14-9dc0-da4b7c138d9c"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:27.160785 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:27.166493 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-715d562b-9310-46e9-ade7-267cefb19b71 req-2b8c8894-dc7c-45d9-aa05-1298dab7f2bf service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:27.166930 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-715d562b-9310-46e9-ade7-267cefb19b71 req-2b8c8894-dc7c-45d9-aa05-1298dab7f2bf service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:27.179490 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-715d562b-9310-46e9-ade7-267cefb19b71 req-2b8c8894-dc7c-45d9-aa05-1298dab7f2bf service nova] Creating event network-vif-deleted:04d5111b-566e-4d14-9dc0-da4b7c138d9c for instance 93c24894-61e7-4321-a525-49cf1fff7bd8 on hv-cinder-84488 Jul 12 18:36:27.184455 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-715d562b-9310-46e9-ade7-267cefb19b71 req-2b8c8894-dc7c-45d9-aa05-1298dab7f2bf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031441 Jul 12 18:36:27.185075 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 446/934] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:36:27.983085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-50cb494f-55eb-4c08-ab37-7cf2b7291710 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:27.983679 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-50cb494f-55eb-4c08-ab37-7cf2b7291710 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:27.997825 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-50cb494f-55eb-4c08-ab37-7cf2b7291710 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:27.997825 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-50cb494f-55eb-4c08-ab37-7cf2b7291710 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:27.997825 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-50cb494f-55eb-4c08-ab37-7cf2b7291710 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:27.997825 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-50cb494f-55eb-4c08-ab37-7cf2b7291710 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:28.027720 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-50cb494f-55eb-4c08-ab37-7cf2b7291710 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:28.028085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-50cb494f-55eb-4c08-ab37-7cf2b7291710 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:28.028554 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-50cb494f-55eb-4c08-ab37-7cf2b7291710 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lazy-loading 'fault' on Instance uuid 93c24894-61e7-4321-a525-49cf1fff7bd8 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:36:28.073085 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-50cb494f-55eb-4c08-ab37-7cf2b7291710 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:28.080962 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-50cb494f-55eb-4c08-ab37-7cf2b7291710 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 200 len: 1330 microversion: 2.1 time: 0.101720 Jul 12 18:36:28.081546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 489/935] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:27 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:29.100407 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c4bc39cc-26c5-4660-b6bd-7e5049622d01 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:29.101096 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c4bc39cc-26c5-4660-b6bd-7e5049622d01 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:29.107876 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4bc39cc-26c5-4660-b6bd-7e5049622d01 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:29.108328 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4bc39cc-26c5-4660-b6bd-7e5049622d01 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:29.109163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4bc39cc-26c5-4660-b6bd-7e5049622d01 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:29.109595 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4bc39cc-26c5-4660-b6bd-7e5049622d01 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:29.123209 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-c4bc39cc-26c5-4660-b6bd-7e5049622d01 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c4bc39cc-26c5-4660-b6bd-7e5049622d01 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 HTTP/1.1 Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:36:29.128486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:36:29.130263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '93c24894-61e7-4321-a525-49cf1fff7bd8'} Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:36:29.131602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:36:29.133065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:36:29.134230 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c4bc39cc-26c5-4660-b6bd-7e5049622d01 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:36:29.134230 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c4bc39cc-26c5-4660-b6bd-7e5049622d01 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 404 len: 111 microversion: 2.1 time: 0.030932 Jul 12 18:36:29.134230 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 447/936] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:29 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:36:29.135972 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c2b49ab3-ac91-4eb5-8cd7-21b5778e3aa9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '.version_select at 0x7f1bb0a78ca0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:29.222309 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c2b49ab3-ac91-4eb5-8cd7-21b5778e3aa9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-922027170" status: 202 len: 0 microversion: 2.1 time: 0.090222 Jul 12 18:36:29.222810 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 490/937] 10.222.0.47 () {58 vars in 1217 bytes} [Tue Jul 12 18:36:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-922027170 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:36:30.305397 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a0646bf9-cb4d-49bd-b030-af8abc26c4bf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: .version_select at 0x7f1bb1439820>, body: {"keypair": {"name": "tempest-keypair-1777568864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQJZCOP4bwr7K09PSCnUPZSQSX9pN+8MNWpVD1cdFmrmi08tYuq/2q2LaaxPAnO0OS5QlIWXbghCJ43U3T3b4vG1VbWwQSzMgU/J9ONcmt+nS06416fe2lil2JnOH6QTw=="}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:30.321342 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-a0646bf9-cb4d-49bd-b030-af8abc26c4bf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for project cec39457db974eebbc0305cc555a64d4. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:36:30.325089 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-a0646bf9-cb4d-49bd-b030-af8abc26c4bf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for user 4d41a6703cec435dbb7e687aa0088d05 and project cec39457db974eebbc0305cc555a64d4. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:36:30.407063 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a0646bf9-cb4d-49bd-b030-af8abc26c4bf tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105849 Jul 12 18:36:30.407666 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 448/938] 10.222.0.47 () {60 vars in 1158 bytes} [Tue Jul 12 18:36:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:36:32.814520 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1562461157", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "363a49e9-fc6d-4564-a5c2-668089b41523"}], "security_groups": [{"name": "tempest-securitygroup--668621038"}], "key_name": "tempest-keypair-1777568864", "user_data": "}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:32.927025 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.network.neutron [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] validate_networks() for [('363a49e9-fc6d-4564-a5c2-668089b41523', None, None, None, None, None)] {{(pid=118411) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:36:33.341798 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Flavor limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:36:33.342224 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Image limits 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:36:33.342703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Flavor pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:36:33.343124 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Image pref 0:0:0 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:36:33.343544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.virt.hardware [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118411) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:36:33.355435 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:33.355885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:33.356733 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:33.357962 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:33.382057 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for project cec39457db974eebbc0305cc555a64d4. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:36:33.387165 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Getting quotas for user 4d41a6703cec435dbb7e687aa0088d05 and project cec39457db974eebbc0305cc555a64d4. Resources: {'instances', 'ram', 'cores'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:36:33.401303 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Going to run 1 instances... {{(pid=118411) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:36:33.403589 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118411) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:36:33.553331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [96cb16b3-2bac-4f81-a115-f03f2fe44935] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 12 18:36:34.560443 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO oslo.messaging._drivers.impl_rabbit [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [96cb16b3-2bac-4f81-a115-f03f2fe44935] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 58020. Jul 12 18:36:34.564269 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fbece7f9-6cb5-4d5e-a3d3-b8e7e5764f07 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.754732 Jul 12 18:36:34.564931 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 491/939] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:36:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:36:34.576067 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-050d10c5-083b-4835-8bcd-f0a6724c0474 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:34.576688 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-050d10c5-083b-4835-8bcd-f0a6724c0474 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:34.633752 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-050d10c5-083b-4835-8bcd-f0a6724c0474 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:34.640776 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-050d10c5-083b-4835-8bcd-f0a6724c0474 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1242 microversion: 2.1 time: 0.069334 Jul 12 18:36:34.641435 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 449/940] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:34 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:35.658297 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-451676ba-2684-4697-94b1-d458fef44f67 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:35.658912 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-451676ba-2684-4697-94b1-d458fef44f67 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:35.665795 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-451676ba-2684-4697-94b1-d458fef44f67 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:35.666249 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-451676ba-2684-4697-94b1-d458fef44f67 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:35.667014 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-451676ba-2684-4697-94b1-d458fef44f67 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:35.667453 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-451676ba-2684-4697-94b1-d458fef44f67 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:35.732243 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-451676ba-2684-4697-94b1-d458fef44f67 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:35.739804 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-451676ba-2684-4697-94b1-d458fef44f67 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1246 microversion: 2.1 time: 0.086003 Jul 12 18:36:35.740377 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 492/941] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:35 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:36.757323 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d09f4037-590d-4cf7-9562-b7ffdb7f14f2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:36.757875 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d09f4037-590d-4cf7-9562-b7ffdb7f14f2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:36.765338 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d09f4037-590d-4cf7-9562-b7ffdb7f14f2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:36.765702 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d09f4037-590d-4cf7-9562-b7ffdb7f14f2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:36.766477 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d09f4037-590d-4cf7-9562-b7ffdb7f14f2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:36.766911 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d09f4037-590d-4cf7-9562-b7ffdb7f14f2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:36.842501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d09f4037-590d-4cf7-9562-b7ffdb7f14f2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:36.850379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d09f4037-590d-4cf7-9562-b7ffdb7f14f2 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1302 microversion: 2.1 time: 0.096978 Jul 12 18:36:36.851150 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 450/942] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:36 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1302 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:37.867140 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-66bc955a-8c10-448c-9604-e6e85d096b4c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:37.867826 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-66bc955a-8c10-448c-9604-e6e85d096b4c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:37.875071 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-66bc955a-8c10-448c-9604-e6e85d096b4c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:37.875767 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-66bc955a-8c10-448c-9604-e6e85d096b4c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:37.876734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-66bc955a-8c10-448c-9604-e6e85d096b4c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:37.877161 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-66bc955a-8c10-448c-9604-e6e85d096b4c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:38.160889 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-66bc955a-8c10-448c-9604-e6e85d096b4c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:38.168812 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-66bc955a-8c10-448c-9604-e6e85d096b4c tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1367 microversion: 2.1 time: 0.305622 Jul 12 18:36:38.169428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 493/943] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:37 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:38.612579 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-91ac28fd-bf14-4830-9420-2ad6696cc9f6 req-8a0e69a8-f589-4ef8-a9ff-99007125d1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6fb941-0021-4c8a-b781-6b7429658b54", "tag": "62d12241-643c-4be4-8143-c8c32513b4db"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:38.623606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-91ac28fd-bf14-4830-9420-2ad6696cc9f6 req-8a0e69a8-f589-4ef8-a9ff-99007125d1b0 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:38.627658 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-91ac28fd-bf14-4830-9420-2ad6696cc9f6 req-8a0e69a8-f589-4ef8-a9ff-99007125d1b0 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:38.647449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-91ac28fd-bf14-4830-9420-2ad6696cc9f6 req-8a0e69a8-f589-4ef8-a9ff-99007125d1b0 service nova] Creating event network-changed:62d12241-643c-4be4-8143-c8c32513b4db for instance eb6fb941-0021-4c8a-b781-6b7429658b54 on hv-cinder-84488 Jul 12 18:36:38.653419 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-91ac28fd-bf14-4830-9420-2ad6696cc9f6 req-8a0e69a8-f589-4ef8-a9ff-99007125d1b0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045471 Jul 12 18:36:38.653965 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 451/944] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:36:39.185979 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bd800170-4fec-444a-b180-b4b5415c25b9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:39.186581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-bd800170-4fec-444a-b180-b4b5415c25b9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:39.193355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bd800170-4fec-444a-b180-b4b5415c25b9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:39.195091 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bd800170-4fec-444a-b180-b4b5415c25b9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:39.195091 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bd800170-4fec-444a-b180-b4b5415c25b9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:39.195091 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bd800170-4fec-444a-b180-b4b5415c25b9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:39.331465 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-bd800170-4fec-444a-b180-b4b5415c25b9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:39.339779 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bd800170-4fec-444a-b180-b4b5415c25b9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1367 microversion: 2.1 time: 0.157630 Jul 12 18:36:39.340363 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 494/945] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:39 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:40.358191 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-10a28abf-c078-45f8-b12f-fe523001c507 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:40.359005 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-10a28abf-c078-45f8-b12f-fe523001c507 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:40.365529 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-10a28abf-c078-45f8-b12f-fe523001c507 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:40.365970 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-10a28abf-c078-45f8-b12f-fe523001c507 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:40.366733 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-10a28abf-c078-45f8-b12f-fe523001c507 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:40.367160 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-10a28abf-c078-45f8-b12f-fe523001c507 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:40.505881 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-10a28abf-c078-45f8-b12f-fe523001c507 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:40.514176 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-10a28abf-c078-45f8-b12f-fe523001c507 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1367 microversion: 2.1 time: 0.161008 Jul 12 18:36:40.514739 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 452/946] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:40 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:41.532433 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cd80008d-bd6a-4b25-8461-48238fd158be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:41.533064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-cd80008d-bd6a-4b25-8461-48238fd158be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:41.539553 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd80008d-bd6a-4b25-8461-48238fd158be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:41.539997 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd80008d-bd6a-4b25-8461-48238fd158be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:41.540803 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd80008d-bd6a-4b25-8461-48238fd158be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:41.541243 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-cd80008d-bd6a-4b25-8461-48238fd158be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:41.670184 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-cd80008d-bd6a-4b25-8461-48238fd158be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:41.677624 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-cd80008d-bd6a-4b25-8461-48238fd158be tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1367 microversion: 2.1 time: 0.149153 Jul 12 18:36:41.678183 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 495/947] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:41 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:42.539043 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-cac51aad-6f6d-4eea-b415-cf0fe2f4ea36 req-9883c02c-da14-4b94-980d-0206ac592b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6fb941-0021-4c8a-b781-6b7429658b54", "name": "network-vif-plugged", "status": "completed", "tag": "62d12241-643c-4be4-8143-c8c32513b4db"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:42.548666 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-cac51aad-6f6d-4eea-b415-cf0fe2f4ea36 req-9883c02c-da14-4b94-980d-0206ac592b16 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:42.549103 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-cac51aad-6f6d-4eea-b415-cf0fe2f4ea36 req-9883c02c-da14-4b94-980d-0206ac592b16 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:42.561004 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-cac51aad-6f6d-4eea-b415-cf0fe2f4ea36 req-9883c02c-da14-4b94-980d-0206ac592b16 service nova] Creating event network-vif-plugged:62d12241-643c-4be4-8143-c8c32513b4db for instance eb6fb941-0021-4c8a-b781-6b7429658b54 on hv-cinder-84488 Jul 12 18:36:42.565868 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-cac51aad-6f6d-4eea-b415-cf0fe2f4ea36 req-9883c02c-da14-4b94-980d-0206ac592b16 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030438 Jul 12 18:36:42.566464 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 453/948] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:36:42.693911 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e0f2486a-2aef-47a3-95b2-31dfc4431b1b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:42.694561 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e0f2486a-2aef-47a3-95b2-31dfc4431b1b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:42.701734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e0f2486a-2aef-47a3-95b2-31dfc4431b1b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:42.702194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e0f2486a-2aef-47a3-95b2-31dfc4431b1b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:42.702973 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e0f2486a-2aef-47a3-95b2-31dfc4431b1b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:42.703607 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e0f2486a-2aef-47a3-95b2-31dfc4431b1b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:42.842548 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e0f2486a-2aef-47a3-95b2-31dfc4431b1b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:42.850053 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e0f2486a-2aef-47a3-95b2-31dfc4431b1b tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1367 microversion: 2.1 time: 0.160054 Jul 12 18:36:42.850606 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 496/949] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:42 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:36:43.868067 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4e2ea165-0457-416b-9167-ea6906c68fdd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:43.868777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4e2ea165-0457-416b-9167-ea6906c68fdd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:43.876760 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e2ea165-0457-416b-9167-ea6906c68fdd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:43.877197 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e2ea165-0457-416b-9167-ea6906c68fdd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:43.877949 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e2ea165-0457-416b-9167-ea6906c68fdd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:43.878371 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e2ea165-0457-416b-9167-ea6906c68fdd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:44.014304 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4e2ea165-0457-416b-9167-ea6906c68fdd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:44.021965 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4e2ea165-0457-416b-9167-ea6906c68fdd tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1367 microversion: 2.1 time: 0.158166 Jul 12 18:36:44.022535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 454/950] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:43 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:45.040079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-24ca5b4d-659b-4e0a-b202-ba2cf195c52a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:45.040713 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-24ca5b4d-659b-4e0a-b202-ba2cf195c52a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:45.042643 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:45.043387 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=6 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:45.048918 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-24ca5b4d-659b-4e0a-b202-ba2cf195c52a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:45.049362 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-24ca5b4d-659b-4e0a-b202-ba2cf195c52a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:45.050119 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-24ca5b4d-659b-4e0a-b202-ba2cf195c52a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:45.050546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-24ca5b4d-659b-4e0a-b202-ba2cf195c52a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:45.182413 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-24ca5b4d-659b-4e0a-b202-ba2cf195c52a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:36:45.190875 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-24ca5b4d-659b-4e0a-b202-ba2cf195c52a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1558 microversion: 2.1 time: 0.155125 Jul 12 18:36:45.191446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 497/951] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:36:45 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:36:45.207255 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-522ec8bd-28b8-422d-9c40-e7bb27225bee tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:36:45.207768 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-522ec8bd-28b8-422d-9c40-e7bb27225bee tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:36:45.209749 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:36:45.215147 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-522ec8bd-28b8-422d-9c40-e7bb27225bee tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:45.216065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-522ec8bd-28b8-422d-9c40-e7bb27225bee tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:45.216513 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-522ec8bd-28b8-422d-9c40-e7bb27225bee tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:45.216941 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-522ec8bd-28b8-422d-9c40-e7bb27225bee tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:45.295426 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-522ec8bd-28b8-422d-9c40-e7bb27225bee tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091899 Jul 12 18:36:45.296012 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 455/952] 10.222.0.47 () {58 vars in 1274 bytes} [Tue Jul 12 18:36:45 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:36:46.304423 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-fdbbb7b9-8f41-4510-b6f2-94d8d0617181 req-1af6d54d-4c42-4013-a226-82a65d7b63bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6fb941-0021-4c8a-b781-6b7429658b54", "tag": "62d12241-643c-4be4-8143-c8c32513b4db"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:36:46.313940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-fdbbb7b9-8f41-4510-b6f2-94d8d0617181 req-1af6d54d-4c42-4013-a226-82a65d7b63bb service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:36:46.314388 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-fdbbb7b9-8f41-4510-b6f2-94d8d0617181 req-1af6d54d-4c42-4013-a226-82a65d7b63bb service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:36:46.326376 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-fdbbb7b9-8f41-4510-b6f2-94d8d0617181 req-1af6d54d-4c42-4013-a226-82a65d7b63bb service nova] Creating event network-changed:62d12241-643c-4be4-8143-c8c32513b4db for instance eb6fb941-0021-4c8a-b781-6b7429658b54 on hv-cinder-84488 Jul 12 18:36:46.331517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-fdbbb7b9-8f41-4510-b6f2-94d8d0617181 req-1af6d54d-4c42-4013-a226-82a65d7b63bb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030912 Jul 12 18:36:46.332106 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 498/953] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:37:22.282856 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:22.283699 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:22.287616 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a16fe685-447f-4b46-8ec5-c2ceda37bb49 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:22.288100 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a16fe685-447f-4b46-8ec5-c2ceda37bb49 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:22.294759 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a16fe685-447f-4b46-8ec5-c2ceda37bb49 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:22.296122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a16fe685-447f-4b46-8ec5-c2ceda37bb49 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:22.296122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a16fe685-447f-4b46-8ec5-c2ceda37bb49 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:22.296354 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a16fe685-447f-4b46-8ec5-c2ceda37bb49 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:22.321276 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a16fe685-447f-4b46-8ec5-c2ceda37bb49 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/ips" status: 200 len: 149 microversion: 2.1 time: 0.039795 Jul 12 18:37:22.324842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 456/954] 10.222.0.47 () {58 vars in 1247 bytes} [Tue Jul 12 18:37:22 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:37:23.915097 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:23.915847 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=60 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:23.921021 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-af8cb51b-6563-41fb-a5ea-b71c5fb11b33 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72d03ba3-2fd3-4245-9840-c9a6803ab3e9"}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:37:23.922163 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-af8cb51b-6563-41fb-a5ea-b71c5fb11b33 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:23.928296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-af8cb51b-6563-41fb-a5ea-b71c5fb11b33 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:23.928773 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-af8cb51b-6563-41fb-a5ea-b71c5fb11b33 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:23.929534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-af8cb51b-6563-41fb-a5ea-b71c5fb11b33 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:23.930029 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-af8cb51b-6563-41fb-a5ea-b71c5fb11b33 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:24.850217 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-af8cb51b-6563-41fb-a5ea-b71c5fb11b33 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "POST /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.936529 Jul 12 18:37:24.850821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 499/955] 10.222.0.47 () {60 vars in 1322 bytes} [Tue Jul 12 18:37:23 2022] POST /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:37:32.446179 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d0999834-f657-4375-8d0e-7b3a9df70b34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:32.446708 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d0999834-f657-4375-8d0e-7b3a9df70b34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:32.453963 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d0999834-f657-4375-8d0e-7b3a9df70b34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:32.454438 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d0999834-f657-4375-8d0e-7b3a9df70b34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:32.455213 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d0999834-f657-4375-8d0e-7b3a9df70b34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:32.455635 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d0999834-f657-4375-8d0e-7b3a9df70b34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:32.536183 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-d0999834-f657-4375-8d0e-7b3a9df70b34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lazy-loading 'services' on Instance uuid eb6fb941-0021-4c8a-b781-6b7429658b54 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:37:32.776149 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d0999834-f657-4375-8d0e-7b3a9df70b34 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-volume_attachments/72d03ba3-2fd3-4245-9840-c9a6803ab3e9" status: 202 len: 0 microversion: 2.1 time: 0.334325 Jul 12 18:37:32.776733 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 457/956] 10.222.0.47 () {58 vars in 1415 bytes} [Tue Jul 12 18:37:32 2022] DELETE /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-volume_attachments/72d03ba3-2fd3-4245-9840-c9a6803ab3e9 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:37:32.786811 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b707a9bd-3974-4d74-9ed1-ff443c1ea5fb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:32.787817 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b707a9bd-3974-4d74-9ed1-ff443c1ea5fb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:32.794113 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b707a9bd-3974-4d74-9ed1-ff443c1ea5fb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:32.796976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b707a9bd-3974-4d74-9ed1-ff443c1ea5fb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:32.796976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b707a9bd-3974-4d74-9ed1-ff443c1ea5fb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:32.796976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b707a9bd-3974-4d74-9ed1-ff443c1ea5fb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:32.825786 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b707a9bd-3974-4d74-9ed1-ff443c1ea5fb tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044462 Jul 12 18:37:32.826339 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 500/957] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:37:32 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:37:33.839403 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8654a901-9acd-4fc0-b5e4-4826a6eba488 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:33.840552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8654a901-9acd-4fc0-b5e4-4826a6eba488 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:33.848155 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8654a901-9acd-4fc0-b5e4-4826a6eba488 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:33.848743 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8654a901-9acd-4fc0-b5e4-4826a6eba488 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:33.849588 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8654a901-9acd-4fc0-b5e4-4826a6eba488 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:33.850023 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8654a901-9acd-4fc0-b5e4-4826a6eba488 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:33.881849 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8654a901-9acd-4fc0-b5e4-4826a6eba488 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048142 Jul 12 18:37:33.882406 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 458/958] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:37:33 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:37:34.894454 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-43b88623-6a60-4cbb-b653-84def293a144 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:34.895388 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-43b88623-6a60-4cbb-b653-84def293a144 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:34.902218 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43b88623-6a60-4cbb-b653-84def293a144 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:34.902668 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43b88623-6a60-4cbb-b653-84def293a144 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:34.903524 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43b88623-6a60-4cbb-b653-84def293a144 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:34.904003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-43b88623-6a60-4cbb-b653-84def293a144 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:34.932427 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-43b88623-6a60-4cbb-b653-84def293a144 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042657 Jul 12 18:37:34.932977 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 501/959] 10.222.0.47 () {58 vars in 1301 bytes} [Tue Jul 12 18:37:34 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:37:34.989983 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ed3baadb-93c3-4f2c-beab-62366140559a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:34.990479 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ed3baadb-93c3-4f2c-beab-62366140559a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:34.997378 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ed3baadb-93c3-4f2c-beab-62366140559a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:34.997845 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ed3baadb-93c3-4f2c-beab-62366140559a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:34.998617 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ed3baadb-93c3-4f2c-beab-62366140559a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:34.999045 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ed3baadb-93c3-4f2c-beab-62366140559a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:35.025925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ed3baadb-93c3-4f2c-beab-62366140559a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:37:35.325591 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ed3baadb-93c3-4f2c-beab-62366140559a tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 204 len: 0 microversion: 2.1 time: 0.339062 Jul 12 18:37:35.326298 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 459/960] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:37:34 2022] DELETE /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:37:35.335604 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7a04ea2d-12d9-4336-9abc-db7e6ccb85aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:35.336826 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7a04ea2d-12d9-4336-9abc-db7e6ccb85aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:35.342316 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a04ea2d-12d9-4336-9abc-db7e6ccb85aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:35.342770 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a04ea2d-12d9-4336-9abc-db7e6ccb85aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:35.343535 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a04ea2d-12d9-4336-9abc-db7e6ccb85aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:35.343970 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7a04ea2d-12d9-4336-9abc-db7e6ccb85aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:35.478415 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7a04ea2d-12d9-4336-9abc-db7e6ccb85aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:37:35.486177 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7a04ea2d-12d9-4336-9abc-db7e6ccb85aa tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1681 microversion: 2.1 time: 0.154389 Jul 12 18:37:35.486752 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 502/961] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:37:35 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:37:36.504439 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-df3d2bc0-0aca-4072-a225-611a469fd421 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:36.505145 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-df3d2bc0-0aca-4072-a225-611a469fd421 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:36.511999 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-df3d2bc0-0aca-4072-a225-611a469fd421 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:36.512474 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-df3d2bc0-0aca-4072-a225-611a469fd421 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:36.513248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-df3d2bc0-0aca-4072-a225-611a469fd421 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:36.513681 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-df3d2bc0-0aca-4072-a225-611a469fd421 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:36.650144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-df3d2bc0-0aca-4072-a225-611a469fd421 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:37:36.658163 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-df3d2bc0-0aca-4072-a225-611a469fd421 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1681 microversion: 2.1 time: 0.158219 Jul 12 18:37:36.658725 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 460/962] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:37:36 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:37:37.675832 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bfaf4469-d66f-4411-a877-1bb39569eee8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:37.676449 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-bfaf4469-d66f-4411-a877-1bb39569eee8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:37.682608 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bfaf4469-d66f-4411-a877-1bb39569eee8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:37.683056 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bfaf4469-d66f-4411-a877-1bb39569eee8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:37.683810 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bfaf4469-d66f-4411-a877-1bb39569eee8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:37.684241 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bfaf4469-d66f-4411-a877-1bb39569eee8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:37.747385 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-bfaf4469-d66f-4411-a877-1bb39569eee8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:37:37.755483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bfaf4469-d66f-4411-a877-1bb39569eee8 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1614 microversion: 2.1 time: 0.084301 Jul 12 18:37:37.756044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 503/963] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:37:37 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:37:37.866335 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-12185af8-4bb0-45e2-9674-2c5966463ada req-7be32979-71f0-405d-8794-237f6fa41e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6fb941-0021-4c8a-b781-6b7429658b54", "name": "network-vif-deleted", "tag": "62d12241-643c-4be4-8143-c8c32513b4db"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:37:37.877171 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-12185af8-4bb0-45e2-9674-2c5966463ada req-7be32979-71f0-405d-8794-237f6fa41e96 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:37.877462 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-12185af8-4bb0-45e2-9674-2c5966463ada req-7be32979-71f0-405d-8794-237f6fa41e96 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:37.888819 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-12185af8-4bb0-45e2-9674-2c5966463ada req-7be32979-71f0-405d-8794-237f6fa41e96 service nova] Creating event network-vif-deleted:62d12241-643c-4be4-8143-c8c32513b4db for instance eb6fb941-0021-4c8a-b781-6b7429658b54 on hv-cinder-84488 Jul 12 18:37:37.894294 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-12185af8-4bb0-45e2-9674-2c5966463ada req-7be32979-71f0-405d-8794-237f6fa41e96 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033751 Jul 12 18:37:37.896329 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 461/964] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:37:38.773851 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-968ba3ee-296d-4191-89be-36ec00c28050 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:38.774534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-968ba3ee-296d-4191-89be-36ec00c28050 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:38.781601 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-968ba3ee-296d-4191-89be-36ec00c28050 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:38.782046 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-968ba3ee-296d-4191-89be-36ec00c28050 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:38.782875 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-968ba3ee-296d-4191-89be-36ec00c28050 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:38.783235 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-968ba3ee-296d-4191-89be-36ec00c28050 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:38.817996 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-968ba3ee-296d-4191-89be-36ec00c28050 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:38.818486 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-968ba3ee-296d-4191-89be-36ec00c28050 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:38.818939 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-968ba3ee-296d-4191-89be-36ec00c28050 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lazy-loading 'fault' on Instance uuid eb6fb941-0021-4c8a-b781-6b7429658b54 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:37:38.863811 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-968ba3ee-296d-4191-89be-36ec00c28050 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d41a6703cec435dbb7e687aa0088d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cec39457db974eebbc0305cc555a64d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:37:38.872242 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-968ba3ee-296d-4191-89be-36ec00c28050 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 200 len: 1332 microversion: 2.1 time: 0.102334 Jul 12 18:37:38.872918 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 504/965] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:37:38 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:37:39.892458 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-847171aa-571d-4067-92f5-069467704a29 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:39.893182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-847171aa-571d-4067-92f5-069467704a29 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:39.899546 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-847171aa-571d-4067-92f5-069467704a29 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:39.899989 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-847171aa-571d-4067-92f5-069467704a29 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:39.900786 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-847171aa-571d-4067-92f5-069467704a29 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:39.901215 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-847171aa-571d-4067-92f5-069467704a29 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:39.923316 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-847171aa-571d-4067-92f5-069467704a29 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-847171aa-571d-4067-92f5-069467704a29 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 HTTP/1.1 Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:37:39.924843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:39.926590 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'eb6fb941-0021-4c8a-b781-6b7429658b54'} Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:37:39.927538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:39.929174 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:39.931308 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-847171aa-571d-4067-92f5-069467704a29 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:37:39.931308 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-847171aa-571d-4067-92f5-069467704a29 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 404 len: 111 microversion: 2.1 time: 0.039143 Jul 12 18:37:39.931308 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 462/966] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:37:39 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:37:39.935924 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-62486c62-4f70-4e33-b1bb-f227a9bc0cb6 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '.version_select at 0x7f1bb0c64790>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:40.049316 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-62486c62-4f70-4e33-b1bb-f227a9bc0cb6 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777568864" status: 202 len: 0 microversion: 2.1 time: 0.117439 Jul 12 18:37:40.049909 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 505/967] 10.222.0.47 () {58 vars in 1220 bytes} [Tue Jul 12 18:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1777568864 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:37:42.122862 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a7507928-7edd-483b-a058-2d5fbddef440 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:42.123482 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a7507928-7edd-483b-a058-2d5fbddef440 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:42.130612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7507928-7edd-483b-a058-2d5fbddef440 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:42.131051 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7507928-7edd-483b-a058-2d5fbddef440 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:42.131815 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7507928-7edd-483b-a058-2d5fbddef440 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:42.132242 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7507928-7edd-483b-a058-2d5fbddef440 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:42.145449 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-a7507928-7edd-483b-a058-2d5fbddef440 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a7507928-7edd-483b-a058-2d5fbddef440 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 HTTP/1.1 Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:37:42.146981 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:42.148612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'eb6fb941-0021-4c8a-b781-6b7429658b54'} Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:37:42.149552 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:42.151061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:42.152578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a7507928-7edd-483b-a058-2d5fbddef440 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:37:42.152578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a7507928-7edd-483b-a058-2d5fbddef440 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 404 len: 111 microversion: 2.1 time: 0.029632 Jul 12 18:37:42.152578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 463/968] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:37:42 2022] DELETE /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:37:42.157386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-30278733-1d02-4d72-ae14-5f2882b8a66e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:42.158943 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-30278733-1d02-4d72-ae14-5f2882b8a66e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: eb6fb941-0021-4c8a-b781-6b7429658b54] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:42.165731 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30278733-1d02-4d72-ae14-5f2882b8a66e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:42.166188 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30278733-1d02-4d72-ae14-5f2882b8a66e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:42.166954 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30278733-1d02-4d72-ae14-5f2882b8a66e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:42.167388 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-30278733-1d02-4d72-ae14-5f2882b8a66e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:42.181462 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-30278733-1d02-4d72-ae14-5f2882b8a66e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-30278733-1d02-4d72-ae14-5f2882b8a66e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 HTTP/1.1 Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:37:42.183219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:42.184929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': 'eb6fb941-0021-4c8a-b781-6b7429658b54'} Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:37:42.185853 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. Jul 12 18:37:42.187483 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:42.188944 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-30278733-1d02-4d72-ae14-5f2882b8a66e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance eb6fb941-0021-4c8a-b781-6b7429658b54 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:37:42.188944 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-30278733-1d02-4d72-ae14-5f2882b8a66e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54" status: 404 len: 111 microversion: 2.1 time: 0.031630 Jul 12 18:37:42.188944 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 506/969] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:37:42 2022] GET /compute/v2.1/servers/eb6fb941-0021-4c8a-b781-6b7429658b54 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:37:43.469842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f9c727ce-c069-4312-9cc0-13544c34623e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:43.470342 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f9c727ce-c069-4312-9cc0-13544c34623e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:43.477154 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c727ce-c069-4312-9cc0-13544c34623e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:43.477595 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c727ce-c069-4312-9cc0-13544c34623e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:43.478353 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c727ce-c069-4312-9cc0-13544c34623e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:43.478850 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c727ce-c069-4312-9cc0-13544c34623e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:43.496002 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-f9c727ce-c069-4312-9cc0-13544c34623e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f9c727ce-c069-4312-9cc0-13544c34623e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 HTTP/1.1 Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:37:43.497836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:37:43.499502 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '93c24894-61e7-4321-a525-49cf1fff7bd8'} Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:37:43.500366 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:37:43.502697 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.504231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f9c727ce-c069-4312-9cc0-13544c34623e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:37:43.504231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f9c727ce-c069-4312-9cc0-13544c34623e tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 404 len: 111 microversion: 2.1 time: 0.033405 Jul 12 18:37:43.504231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 464/970] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:37:43 2022] DELETE /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:37:43.508852 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f4747f6a-c636-4024-a7c1-bb5f5e5ebdda tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:43.509490 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f4747f6a-c636-4024-a7c1-bb5f5e5ebdda tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 93c24894-61e7-4321-a525-49cf1fff7bd8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:43.516034 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f4747f6a-c636-4024-a7c1-bb5f5e5ebdda tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:43.516513 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f4747f6a-c636-4024-a7c1-bb5f5e5ebdda tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:43.517379 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f4747f6a-c636-4024-a7c1-bb5f5e5ebdda tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:43.517807 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f4747f6a-c636-4024-a7c1-bb5f5e5ebdda tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:43.530869 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-f4747f6a-c636-4024-a7c1-bb5f5e5ebdda tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f4747f6a-c636-4024-a7c1-bb5f5e5ebdda tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 HTTP/1.1 Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:37:43.532396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:37:43.534038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': '93c24894-61e7-4321-a525-49cf1fff7bd8'} Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:37:43.534976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. Jul 12 18:37:43.536609 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.537884 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f4747f6a-c636-4024-a7c1-bb5f5e5ebdda tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance 93c24894-61e7-4321-a525-49cf1fff7bd8 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:37:43.537884 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f4747f6a-c636-4024-a7c1-bb5f5e5ebdda tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8" status: 404 len: 111 microversion: 2.1 time: 0.028889 Jul 12 18:37:43.537884 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 507/971] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:37:43 2022] GET /compute/v2.1/servers/93c24894-61e7-4321-a525-49cf1fff7bd8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:37:43.542374 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5c88d056-6abb-49a9-b441-a9b6544aeffe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:43.542900 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5c88d056-6abb-49a9-b441-a9b6544aeffe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:43.549628 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c88d056-6abb-49a9-b441-a9b6544aeffe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:43.550094 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c88d056-6abb-49a9-b441-a9b6544aeffe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:43.550832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c88d056-6abb-49a9-b441-a9b6544aeffe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:43.551260 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c88d056-6abb-49a9-b441-a9b6544aeffe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:43.565179 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-5c88d056-6abb-49a9-b441-a9b6544aeffe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5c88d056-6abb-49a9-b441-a9b6544aeffe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 HTTP/1.1 Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:37:43.566728 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:37:43.568925 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '62b9b5e7-913a-41d9-aa33-32f8831ef300'} Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:37:43.570014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:37:43.571535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.573367 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5c88d056-6abb-49a9-b441-a9b6544aeffe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:37:43.573367 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5c88d056-6abb-49a9-b441-a9b6544aeffe tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 404 len: 111 microversion: 2.1 time: 0.029551 Jul 12 18:37:43.573367 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 465/972] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:37:43 2022] DELETE /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 18:37:43.582432 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4f39fc0a-036e-410f-8bc7-342f23dc23c9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:43.583043 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4f39fc0a-036e-410f-8bc7-342f23dc23c9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: 62b9b5e7-913a-41d9-aa33-32f8831ef300] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:43.589088 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f39fc0a-036e-410f-8bc7-342f23dc23c9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:43.589531 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f39fc0a-036e-410f-8bc7-342f23dc23c9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:43.590280 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f39fc0a-036e-410f-8bc7-342f23dc23c9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:43.590707 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4f39fc0a-036e-410f-8bc7-342f23dc23c9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:43.605401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-4f39fc0a-036e-410f-8bc7-342f23dc23c9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4f39fc0a-036e-410f-8bc7-342f23dc23c9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 HTTP/1.1 Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:37:43.606905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:37:43.608551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': '62b9b5e7-913a-41d9-aa33-32f8831ef300'} Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:37:43.609470 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. Jul 12 18:37:43.611588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:43.612929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4f39fc0a-036e-410f-8bc7-342f23dc23c9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance 62b9b5e7-913a-41d9-aa33-32f8831ef300 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:37:43.612929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4f39fc0a-036e-410f-8bc7-342f23dc23c9 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300" status: 404 len: 111 microversion: 2.1 time: 0.029697 Jul 12 18:37:43.612929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 508/973] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:37:43 2022] GET /compute/v2.1/servers/62b9b5e7-913a-41d9-aa33-32f8831ef300 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:37:44.914473 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f468e7c6-5078-4939-a2b0-d0c058a0f73d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:44.915011 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f468e7c6-5078-4939-a2b0-d0c058a0f73d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:44.921786 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f468e7c6-5078-4939-a2b0-d0c058a0f73d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:44.922220 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f468e7c6-5078-4939-a2b0-d0c058a0f73d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:44.923036 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f468e7c6-5078-4939-a2b0-d0c058a0f73d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:44.924093 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f468e7c6-5078-4939-a2b0-d0c058a0f73d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:44.937764 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-f468e7c6-5078-4939-a2b0-d0c058a0f73d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f468e7c6-5078-4939-a2b0-d0c058a0f73d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 HTTP/1.1 Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:37:44.939551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:37:44.941245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'ccee0a08-5b3a-4857-a132-58abc74ebdb7'} Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:37:44.942122 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:37:44.943665 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:37:44.945130 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f468e7c6-5078-4939-a2b0-d0c058a0f73d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:37:44.945130 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f468e7c6-5078-4939-a2b0-d0c058a0f73d tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 404 len: 111 microversion: 2.1 time: 0.030519 Jul 12 18:37:44.945130 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 466/974] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:37:44 2022] DELETE /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:37:44.949623 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-be091755-0778-45f4-b203-34202b7dc701 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:44.950257 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-be091755-0778-45f4-b203-34202b7dc701 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] [instance: ccee0a08-5b3a-4857-a132-58abc74ebdb7] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:44.956963 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-be091755-0778-45f4-b203-34202b7dc701 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:44.957407 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-be091755-0778-45f4-b203-34202b7dc701 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:44.958159 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-be091755-0778-45f4-b203-34202b7dc701 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:44.958581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-be091755-0778-45f4-b203-34202b7dc701 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:44.972385 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-be091755-0778-45f4-b203-34202b7dc701 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] HTTP exception thrown: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-be091755-0778-45f4-b203-34202b7dc701 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Request method failure captured: Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 HTTP/1.1 Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb5U96EKHOA-wO9NFAHfJOj67Si5TwacoSQIoJc9NXULM0cyQZ8xIvbXBJoPAPpqoYT5R_YxKXetXagv_5M071g6tzH2xP_c48FOtfdpxNjZWPJ3JnFr5fk2AvrSbGtrnh_GhTR5-8NV0Tizl5ot6iXcjyTcgqK2k-2SmBdvmhKhS3Y Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:37:44.973881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cec39457db974eebbc0305cc555a64d4", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cec39457db974eebbc0305cc555a64d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: cec39457db974eebbc0305cc555a64d4 Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-794402441 Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 4d41a6703cec435dbb7e687aa0088d05 Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-AttachVolumeNegativeTest-794402441-project Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:37:44.975550 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': 'ccee0a08-5b3a-4857-a132-58abc74ebdb7'} Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:37:44.976522 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. Jul 12 18:37:44.978064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:37:44.979428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-be091755-0778-45f4-b203-34202b7dc701 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] Returning 404 to user: Instance ccee0a08-5b3a-4857-a132-58abc74ebdb7 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:37:44.979428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-be091755-0778-45f4-b203-34202b7dc701 tempest-AttachVolumeNegativeTest-794402441 tempest-AttachVolumeNegativeTest-794402441-project] 10.222.0.47 "GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7" status: 404 len: 111 microversion: 2.1 time: 0.029507 Jul 12 18:37:44.979428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 509/975] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:37:44 2022] GET /compute/v2.1/servers/ccee0a08-5b3a-4857-a132-58abc74ebdb7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:37:56.819306 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-885639509", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1121766819", "security_groups": [{"name": "tempest-secgroup-smoke-93854513"}], "block_device_mapping_v2": [{"uuid": "526e7760-83d7-4d7a-abf9-d840b24ba00c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "337a86a6-f7ab-43ec-ae8f-46aa53a87569"}]}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:37:56.827931 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:56.831468 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:56.937904 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] validate_networks() for [('337a86a6-f7ab-43ec-ae8f-46aa53a87569', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:37:57.316651 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:37:57.317146 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:37:57.317611 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:37:57.318009 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:37:57.318413 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:37:57.327668 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:57.328115 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:57.328932 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:57.329592 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:57.347363 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Getting quotas for project 447abd08211d49f9b503130ac5c380b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:37:57.351839 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Getting quotas for user 7a647aab17cf4345800cd9072a7820c0 and project 447abd08211d49f9b503130ac5c380b7. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:37:57.408870 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:37:57.411583 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='526e7760-83d7-4d7a-abf9-d840b24ba00c',volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:37:57.972739 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-51379327-d929-4ed3-a6d5-df306a29557a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.157722 Jul 12 18:37:57.974315 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 467/976] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:37:56 2022] POST /compute/v2.1/servers => generated 404 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:37:57.983305 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f59f845f-5599-4ab7-9a2f-923d85f4a4f0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:57.984192 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f59f845f-5599-4ab7-9a2f-923d85f4a4f0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:57.986604 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:57.987264 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:37:58.043974 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f59f845f-5599-4ab7-9a2f-923d85f4a4f0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:37:58.050733 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f59f845f-5599-4ab7-9a2f-923d85f4a4f0 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1094 microversion: 2.1 time: 0.071252 Jul 12 18:37:58.051287 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 510/977] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:37:57 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:37:59.068209 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-dd102114-217e-48e0-b02a-05e4282e3a3c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:37:59.068862 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-dd102114-217e-48e0-b02a-05e4282e3a3c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:37:59.075164 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd102114-217e-48e0-b02a-05e4282e3a3c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:59.075612 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd102114-217e-48e0-b02a-05e4282e3a3c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:59.076437 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd102114-217e-48e0-b02a-05e4282e3a3c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:37:59.076896 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd102114-217e-48e0-b02a-05e4282e3a3c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:37:59.142199 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dd102114-217e-48e0-b02a-05e4282e3a3c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:37:59.152730 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-dd102114-217e-48e0-b02a-05e4282e3a3c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1144 microversion: 2.1 time: 0.088896 Jul 12 18:37:59.153305 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 468/978] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:37:59 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:00.171608 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b148edb6-aeec-4955-933d-eef9e3bb13b1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:00.172194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b148edb6-aeec-4955-933d-eef9e3bb13b1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:00.184108 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b148edb6-aeec-4955-933d-eef9e3bb13b1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:00.194034 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b148edb6-aeec-4955-933d-eef9e3bb13b1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:00.194955 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b148edb6-aeec-4955-933d-eef9e3bb13b1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:00.195407 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b148edb6-aeec-4955-933d-eef9e3bb13b1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:00.272824 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b148edb6-aeec-4955-933d-eef9e3bb13b1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:00.280673 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b148edb6-aeec-4955-933d-eef9e3bb13b1 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1200 microversion: 2.1 time: 0.114510 Jul 12 18:38:00.281246 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 511/979] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:00 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1200 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:01.298780 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-28702481-7a74-4e74-84f4-dd4914b83558 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:01.299566 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-28702481-7a74-4e74-84f4-dd4914b83558 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:01.306783 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28702481-7a74-4e74-84f4-dd4914b83558 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:01.307411 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28702481-7a74-4e74-84f4-dd4914b83558 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:01.308508 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28702481-7a74-4e74-84f4-dd4914b83558 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:01.309003 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28702481-7a74-4e74-84f4-dd4914b83558 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:01.597181 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-28702481-7a74-4e74-84f4-dd4914b83558 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:01.606310 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-28702481-7a74-4e74-84f4-dd4914b83558 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1276 microversion: 2.1 time: 0.311455 Jul 12 18:38:01.614881 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 469/980] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:01 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1276 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:02.178475 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-b114016b-5de7-483f-8240-21a177618912 req-d436a186-3038-4afe-b085-aee812ba692b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a4ad3d-1558-4562-9b6b-10d350b59196", "tag": "afa4b915-f2c7-480d-8f6b-2fe0fe884075"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:38:02.187714 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-b114016b-5de7-483f-8240-21a177618912 req-d436a186-3038-4afe-b085-aee812ba692b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:02.188152 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-b114016b-5de7-483f-8240-21a177618912 req-d436a186-3038-4afe-b085-aee812ba692b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:02.199738 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-b114016b-5de7-483f-8240-21a177618912 req-d436a186-3038-4afe-b085-aee812ba692b service nova] Creating event network-changed:afa4b915-f2c7-480d-8f6b-2fe0fe884075 for instance a5a4ad3d-1558-4562-9b6b-10d350b59196 on hv-cinder-84488 Jul 12 18:38:02.205895 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-b114016b-5de7-483f-8240-21a177618912 req-d436a186-3038-4afe-b085-aee812ba692b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030687 Jul 12 18:38:02.206292 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 512/981] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:38:02.624386 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-765e19b0-5552-4da8-a8d6-5f3a004beb05 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:02.625003 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-765e19b0-5552-4da8-a8d6-5f3a004beb05 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:02.631704 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-765e19b0-5552-4da8-a8d6-5f3a004beb05 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:02.632152 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-765e19b0-5552-4da8-a8d6-5f3a004beb05 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:02.632960 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-765e19b0-5552-4da8-a8d6-5f3a004beb05 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:02.633397 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-765e19b0-5552-4da8-a8d6-5f3a004beb05 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:03.111275 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-765e19b0-5552-4da8-a8d6-5f3a004beb05 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:03.119647 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-765e19b0-5552-4da8-a8d6-5f3a004beb05 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1264 microversion: 2.1 time: 0.499221 Jul 12 18:38:03.120372 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 470/982] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:02 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1264 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:04.138197 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-61dfd7a4-ff5b-4b83-bb1f-1a0344f419b9 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:04.138929 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-61dfd7a4-ff5b-4b83-bb1f-1a0344f419b9 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:04.145969 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-61dfd7a4-ff5b-4b83-bb1f-1a0344f419b9 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:04.146427 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-61dfd7a4-ff5b-4b83-bb1f-1a0344f419b9 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:04.147185 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-61dfd7a4-ff5b-4b83-bb1f-1a0344f419b9 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:04.147617 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-61dfd7a4-ff5b-4b83-bb1f-1a0344f419b9 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:04.283707 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-61dfd7a4-ff5b-4b83-bb1f-1a0344f419b9 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:04.291571 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-61dfd7a4-ff5b-4b83-bb1f-1a0344f419b9 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1264 microversion: 2.1 time: 0.158348 Jul 12 18:38:04.292139 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 513/983] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:04 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:05.308914 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e5822cfe-7bea-4f74-ac7b-9a664d9aa452 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:05.309530 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e5822cfe-7bea-4f74-ac7b-9a664d9aa452 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:05.316232 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e5822cfe-7bea-4f74-ac7b-9a664d9aa452 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:05.316714 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e5822cfe-7bea-4f74-ac7b-9a664d9aa452 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:05.318068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e5822cfe-7bea-4f74-ac7b-9a664d9aa452 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:05.318495 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e5822cfe-7bea-4f74-ac7b-9a664d9aa452 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:05.452610 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e5822cfe-7bea-4f74-ac7b-9a664d9aa452 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:05.460891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e5822cfe-7bea-4f74-ac7b-9a664d9aa452 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1264 microversion: 2.1 time: 0.155738 Jul 12 18:38:05.461468 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 471/984] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:05 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:06.478218 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7412b7a0-69f7-417d-bf7b-00907c2d168f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:06.478827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7412b7a0-69f7-417d-bf7b-00907c2d168f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:06.485487 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7412b7a0-69f7-417d-bf7b-00907c2d168f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:06.485938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7412b7a0-69f7-417d-bf7b-00907c2d168f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:06.486700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7412b7a0-69f7-417d-bf7b-00907c2d168f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:06.487135 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7412b7a0-69f7-417d-bf7b-00907c2d168f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:06.621951 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7412b7a0-69f7-417d-bf7b-00907c2d168f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:06.629567 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7412b7a0-69f7-417d-bf7b-00907c2d168f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1264 microversion: 2.1 time: 0.155195 Jul 12 18:38:06.630275 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 514/985] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:06 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:07.646837 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7c83b098-6eb5-4ea9-a474-ff32513a12fb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:07.647452 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7c83b098-6eb5-4ea9-a474-ff32513a12fb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:07.649573 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:07.650220 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:07.655035 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c83b098-6eb5-4ea9-a474-ff32513a12fb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:07.655481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c83b098-6eb5-4ea9-a474-ff32513a12fb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:07.656279 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c83b098-6eb5-4ea9-a474-ff32513a12fb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:07.656732 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c83b098-6eb5-4ea9-a474-ff32513a12fb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:07.789311 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7c83b098-6eb5-4ea9-a474-ff32513a12fb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:07.796754 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7c83b098-6eb5-4ea9-a474-ff32513a12fb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1264 microversion: 2.1 time: 0.154545 Jul 12 18:38:07.797325 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 472/986] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:07 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:08.814222 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-58efaf1a-2e49-484b-88a0-781d2e341049 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:08.814863 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-58efaf1a-2e49-484b-88a0-781d2e341049 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:08.817308 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:08.822415 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58efaf1a-2e49-484b-88a0-781d2e341049 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:08.822859 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58efaf1a-2e49-484b-88a0-781d2e341049 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:08.823633 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58efaf1a-2e49-484b-88a0-781d2e341049 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:08.824069 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-58efaf1a-2e49-484b-88a0-781d2e341049 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:08.962781 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-58efaf1a-2e49-484b-88a0-781d2e341049 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:08.970334 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-58efaf1a-2e49-484b-88a0-781d2e341049 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1264 microversion: 2.1 time: 0.160058 Jul 12 18:38:08.970901 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 515/987] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:08 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:38:09.988346 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5a466a2d-b5aa-499b-a550-5ced832990bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:09.988968 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5a466a2d-b5aa-499b-a550-5ced832990bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:09.996559 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a466a2d-b5aa-499b-a550-5ced832990bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:09.997258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a466a2d-b5aa-499b-a550-5ced832990bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:09.998019 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a466a2d-b5aa-499b-a550-5ced832990bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:09.998457 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a466a2d-b5aa-499b-a550-5ced832990bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:10.135068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5a466a2d-b5aa-499b-a550-5ced832990bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:10.142750 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5a466a2d-b5aa-499b-a550-5ced832990bb tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1264 microversion: 2.1 time: 0.158133 Jul 12 18:38:10.143316 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 473/988] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:09 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:11.160200 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-26d1f4e3-080d-49d0-8435-e28ce796ee8f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:11.160833 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-26d1f4e3-080d-49d0-8435-e28ce796ee8f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:11.168818 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-26d1f4e3-080d-49d0-8435-e28ce796ee8f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:11.170664 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-26d1f4e3-080d-49d0-8435-e28ce796ee8f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:11.170664 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-26d1f4e3-080d-49d0-8435-e28ce796ee8f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:11.170664 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-26d1f4e3-080d-49d0-8435-e28ce796ee8f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:11.310048 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-26d1f4e3-080d-49d0-8435-e28ce796ee8f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:11.318280 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-26d1f4e3-080d-49d0-8435-e28ce796ee8f tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1264 microversion: 2.1 time: 0.161808 Jul 12 18:38:11.319038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 516/989] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:11 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:12.516201 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cb72d7df-346b-4a50-82c4-0da221b664ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:12.516967 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cb72d7df-346b-4a50-82c4-0da221b664ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:12.523641 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb72d7df-346b-4a50-82c4-0da221b664ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:12.524090 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb72d7df-346b-4a50-82c4-0da221b664ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:12.524888 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb72d7df-346b-4a50-82c4-0da221b664ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:12.527099 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb72d7df-346b-4a50-82c4-0da221b664ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:12.670371 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cb72d7df-346b-4a50-82c4-0da221b664ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:12.678303 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cb72d7df-346b-4a50-82c4-0da221b664ba tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1264 microversion: 2.1 time: 0.346735 Jul 12 18:38:12.679080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 474/990] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:12 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1264 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:13.110719 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-7b0a6877-1ad7-4603-aeee-55f48640bfcc req-da1e05df-18c2-4505-b94a-27ae38c3261c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a4ad3d-1558-4562-9b6b-10d350b59196", "name": "network-vif-plugged", "status": "completed", "tag": "afa4b915-f2c7-480d-8f6b-2fe0fe884075"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:38:13.120916 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-7b0a6877-1ad7-4603-aeee-55f48640bfcc req-da1e05df-18c2-4505-b94a-27ae38c3261c service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:13.121307 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-7b0a6877-1ad7-4603-aeee-55f48640bfcc req-da1e05df-18c2-4505-b94a-27ae38c3261c service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:13.133078 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-7b0a6877-1ad7-4603-aeee-55f48640bfcc req-da1e05df-18c2-4505-b94a-27ae38c3261c service nova] Creating event network-vif-plugged:afa4b915-f2c7-480d-8f6b-2fe0fe884075 for instance a5a4ad3d-1558-4562-9b6b-10d350b59196 on hv-cinder-84488 Jul 12 18:38:13.138278 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-7b0a6877-1ad7-4603-aeee-55f48640bfcc req-da1e05df-18c2-4505-b94a-27ae38c3261c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031295 Jul 12 18:38:13.138854 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 517/991] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:38:13.695161 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bf47cc1b-6011-4f05-8fc1-5a2629cb0fcc tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:13.695773 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bf47cc1b-6011-4f05-8fc1-5a2629cb0fcc tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:13.707063 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf47cc1b-6011-4f05-8fc1-5a2629cb0fcc tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:13.707063 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf47cc1b-6011-4f05-8fc1-5a2629cb0fcc tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:13.707063 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf47cc1b-6011-4f05-8fc1-5a2629cb0fcc tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:13.707063 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf47cc1b-6011-4f05-8fc1-5a2629cb0fcc tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:13.839350 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bf47cc1b-6011-4f05-8fc1-5a2629cb0fcc tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:13.846692 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bf47cc1b-6011-4f05-8fc1-5a2629cb0fcc tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1264 microversion: 2.1 time: 0.155684 Jul 12 18:38:13.847265 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 475/992] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:13 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:14.865315 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-9773eebe-00f0-4016-b391-81ff6f8e625c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:14.866026 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-9773eebe-00f0-4016-b391-81ff6f8e625c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:14.873170 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9773eebe-00f0-4016-b391-81ff6f8e625c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:14.873573 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9773eebe-00f0-4016-b391-81ff6f8e625c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:14.874323 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9773eebe-00f0-4016-b391-81ff6f8e625c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:14.874753 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-9773eebe-00f0-4016-b391-81ff6f8e625c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:15.010199 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-9773eebe-00f0-4016-b391-81ff6f8e625c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:15.022718 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-9773eebe-00f0-4016-b391-81ff6f8e625c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1451 microversion: 2.1 time: 0.160323 Jul 12 18:38:15.023453 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 518/993] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:14 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:15.039632 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-21c682c3-fc6b-4978-b832-a8ad4377205e tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:15.040554 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-21c682c3-fc6b-4978-b832-a8ad4377205e tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:15.047661 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-21c682c3-fc6b-4978-b832-a8ad4377205e tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:15.053550 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-21c682c3-fc6b-4978-b832-a8ad4377205e tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:15.053550 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-21c682c3-fc6b-4978-b832-a8ad4377205e tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:15.053550 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-21c682c3-fc6b-4978-b832-a8ad4377205e tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:15.198185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-21c682c3-fc6b-4978-b832-a8ad4377205e tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:15.205661 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-21c682c3-fc6b-4978-b832-a8ad4377205e tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1451 microversion: 2.1 time: 0.170486 Jul 12 18:38:15.206347 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 476/994] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:15 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:17.516759 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-c63bb299-a57f-46ad-b8d1-611584ab61f4 req-7f45df81-5c47-438f-898e-f3ce68b13724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a4ad3d-1558-4562-9b6b-10d350b59196", "tag": "afa4b915-f2c7-480d-8f6b-2fe0fe884075"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:38:17.525591 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-c63bb299-a57f-46ad-b8d1-611584ab61f4 req-7f45df81-5c47-438f-898e-f3ce68b13724 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:17.531702 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-c63bb299-a57f-46ad-b8d1-611584ab61f4 req-7f45df81-5c47-438f-898e-f3ce68b13724 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:17.537662 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-c63bb299-a57f-46ad-b8d1-611584ab61f4 req-7f45df81-5c47-438f-898e-f3ce68b13724 service nova] Creating event network-changed:afa4b915-f2c7-480d-8f6b-2fe0fe884075 for instance a5a4ad3d-1558-4562-9b6b-10d350b59196 on hv-cinder-84488 Jul 12 18:38:17.542558 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-c63bb299-a57f-46ad-b8d1-611584ab61f4 req-7f45df81-5c47-438f-898e-f3ce68b13724 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029406 Jul 12 18:38:17.543221 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 519/995] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:38:17.991187 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1778141807", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "networks": [{"uuid": "12e5935b-73da-4ad9-90cb-8253ca02a9ca"}]}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:38:18.049350 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] validate_networks() for [('12e5935b-73da-4ad9-90cb-8253ca02a9ca', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:38:18.575944 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:38:18.576513 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:38:18.576918 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:38:18.577318 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:38:18.577903 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:38:18.587328 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:18.587784 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:18.588821 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:18.589240 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:18.606968 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Getting quotas for project 072667f3650243fc9973a36efad7ae1d. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:38:18.611365 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Getting quotas for user 84f9e5a76bbe4dcf906a1b46f53fa7c3 and project 072667f3650243fc9973a36efad7ae1d. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:38:18.623454 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:38:18.625606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:38:18.760836 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e2504f1d-f7dd-4cad-96ae-48e3f5d99ba8 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.773898 Jul 12 18:38:18.761484 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 477/996] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:38:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:38:18.773396 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-cb28a17e-6d56-481d-a89b-ac769258ccc9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:18.774630 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-cb28a17e-6d56-481d-a89b-ac769258ccc9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:18.830242 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-cb28a17e-6d56-481d-a89b-ac769258ccc9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:18.837110 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-cb28a17e-6d56-481d-a89b-ac769258ccc9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1214 microversion: 2.1 time: 0.069288 Jul 12 18:38:18.837834 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 520/997] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:18 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:19.855424 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c54c53d5-b6e1-4d74-8b28-8acd883df3ba tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:19.856058 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c54c53d5-b6e1-4d74-8b28-8acd883df3ba tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:19.911036 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c54c53d5-b6e1-4d74-8b28-8acd883df3ba tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:19.918290 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c54c53d5-b6e1-4d74-8b28-8acd883df3ba tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1214 microversion: 2.1 time: 0.067244 Jul 12 18:38:19.918860 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 478/998] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:19 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:20.935047 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-b2b81edc-97d8-44c9-a884-946ea3f6cf00 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:20.935753 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-b2b81edc-97d8-44c9-a884-946ea3f6cf00 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:20.943046 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b2b81edc-97d8-44c9-a884-946ea3f6cf00 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:20.943490 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b2b81edc-97d8-44c9-a884-946ea3f6cf00 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:20.944286 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b2b81edc-97d8-44c9-a884-946ea3f6cf00 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:20.944716 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-b2b81edc-97d8-44c9-a884-946ea3f6cf00 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:21.009812 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-b2b81edc-97d8-44c9-a884-946ea3f6cf00 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:21.018058 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-b2b81edc-97d8-44c9-a884-946ea3f6cf00 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1266 microversion: 2.1 time: 0.086801 Jul 12 18:38:21.018667 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 521/999] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:20 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:22.035839 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f28336d5-e3f9-4f97-a1cd-1048814c08a7 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:22.037026 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f28336d5-e3f9-4f97-a1cd-1048814c08a7 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:22.043873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f28336d5-e3f9-4f97-a1cd-1048814c08a7 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:22.044323 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f28336d5-e3f9-4f97-a1cd-1048814c08a7 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:22.050570 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f28336d5-e3f9-4f97-a1cd-1048814c08a7 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:22.050570 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f28336d5-e3f9-4f97-a1cd-1048814c08a7 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:22.245289 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f28336d5-e3f9-4f97-a1cd-1048814c08a7 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:22.253019 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f28336d5-e3f9-4f97-a1cd-1048814c08a7 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1314 microversion: 2.1 time: 0.221041 Jul 12 18:38:22.253905 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 479/1000] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:22 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:23.270705 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1bc08f5d-f7c2-433e-ad8d-e656875152aa tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:23.271347 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1bc08f5d-f7c2-433e-ad8d-e656875152aa tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:23.277766 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bc08f5d-f7c2-433e-ad8d-e656875152aa tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:23.278211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bc08f5d-f7c2-433e-ad8d-e656875152aa tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:23.278976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bc08f5d-f7c2-433e-ad8d-e656875152aa tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:23.279402 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1bc08f5d-f7c2-433e-ad8d-e656875152aa tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:23.405443 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-2314aa08-3d01-4c7e-ab9e-fd470984202e req-ab5967ec-93fb-4fb1-a957-090eab2aad06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe46a662-3676-4164-a5f1-453182ddcb30", "tag": "0a7f8a3d-0e85-4d9b-848c-60bc701c0f9b"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:38:23.416145 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-2314aa08-3d01-4c7e-ab9e-fd470984202e req-ab5967ec-93fb-4fb1-a957-090eab2aad06 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:23.419937 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-2314aa08-3d01-4c7e-ab9e-fd470984202e req-ab5967ec-93fb-4fb1-a957-090eab2aad06 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:23.423760 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1bc08f5d-f7c2-433e-ad8d-e656875152aa tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:23.430422 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-2314aa08-3d01-4c7e-ab9e-fd470984202e req-ab5967ec-93fb-4fb1-a957-090eab2aad06 service nova] Creating event network-changed:0a7f8a3d-0e85-4d9b-848c-60bc701c0f9b for instance fe46a662-3676-4164-a5f1-453182ddcb30 on hv-cinder-84488 Jul 12 18:38:23.433097 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1bc08f5d-f7c2-433e-ad8d-e656875152aa tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1314 microversion: 2.1 time: 0.166321 Jul 12 18:38:23.443932 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 522/1001] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:23 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:23.449358 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-2314aa08-3d01-4c7e-ab9e-fd470984202e req-ab5967ec-93fb-4fb1-a957-090eab2aad06 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046253 Jul 12 18:38:23.453043 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 480/1002] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:38:24.450414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-065e9c03-c9a1-41b1-823a-e7b0cead26e5 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:24.451255 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-065e9c03-c9a1-41b1-823a-e7b0cead26e5 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:24.458848 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-065e9c03-c9a1-41b1-823a-e7b0cead26e5 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:24.459298 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-065e9c03-c9a1-41b1-823a-e7b0cead26e5 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:24.460122 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-065e9c03-c9a1-41b1-823a-e7b0cead26e5 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:24.460579 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-065e9c03-c9a1-41b1-823a-e7b0cead26e5 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:24.596657 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-065e9c03-c9a1-41b1-823a-e7b0cead26e5 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:24.604403 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-065e9c03-c9a1-41b1-823a-e7b0cead26e5 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1314 microversion: 2.1 time: 0.157972 Jul 12 18:38:24.604899 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 523/1003] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:24 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:25.622663 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c18e0266-62c4-4fb5-bd1e-5407f7b0d82c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:25.623364 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c18e0266-62c4-4fb5-bd1e-5407f7b0d82c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:25.629975 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c18e0266-62c4-4fb5-bd1e-5407f7b0d82c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:25.630607 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c18e0266-62c4-4fb5-bd1e-5407f7b0d82c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:25.631561 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c18e0266-62c4-4fb5-bd1e-5407f7b0d82c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:25.631995 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c18e0266-62c4-4fb5-bd1e-5407f7b0d82c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:25.782903 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c18e0266-62c4-4fb5-bd1e-5407f7b0d82c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:25.791828 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c18e0266-62c4-4fb5-bd1e-5407f7b0d82c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1314 microversion: 2.1 time: 0.173432 Jul 12 18:38:25.791828 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 481/1004] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:25 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:26.811324 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-8f6c5669-b945-4ff4-8461-1b79efb11aeb tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:26.812244 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-8f6c5669-b945-4ff4-8461-1b79efb11aeb tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:26.820419 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8f6c5669-b945-4ff4-8461-1b79efb11aeb tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:26.820879 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8f6c5669-b945-4ff4-8461-1b79efb11aeb tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:26.821661 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8f6c5669-b945-4ff4-8461-1b79efb11aeb tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:26.822090 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-8f6c5669-b945-4ff4-8461-1b79efb11aeb tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:26.957574 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-8f6c5669-b945-4ff4-8461-1b79efb11aeb tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:26.966291 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-8f6c5669-b945-4ff4-8461-1b79efb11aeb tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1314 microversion: 2.1 time: 0.160983 Jul 12 18:38:26.967674 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 524/1005] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:26 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:27.982984 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7851aaf4-e4ec-46d2-bc47-6a03fa62449a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:27.983642 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7851aaf4-e4ec-46d2-bc47-6a03fa62449a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:27.986031 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:27.991320 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7851aaf4-e4ec-46d2-bc47-6a03fa62449a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:27.991766 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7851aaf4-e4ec-46d2-bc47-6a03fa62449a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:27.992585 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7851aaf4-e4ec-46d2-bc47-6a03fa62449a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:27.993017 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7851aaf4-e4ec-46d2-bc47-6a03fa62449a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:27.995792 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=73 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:28.138080 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7851aaf4-e4ec-46d2-bc47-6a03fa62449a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:28.146571 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7851aaf4-e4ec-46d2-bc47-6a03fa62449a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1314 microversion: 2.1 time: 0.167410 Jul 12 18:38:28.149694 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 482/1006] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:27 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:29.019800 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-d10a811f-556f-44af-8374-fd3abfdcf1bd req-62471ed8-5ab2-42d9-b444-ee6797d88c49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe46a662-3676-4164-a5f1-453182ddcb30", "name": "network-vif-plugged", "status": "completed", "tag": "0a7f8a3d-0e85-4d9b-848c-60bc701c0f9b"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:38:29.024634 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:29.029956 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-d10a811f-556f-44af-8374-fd3abfdcf1bd req-62471ed8-5ab2-42d9-b444-ee6797d88c49 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:29.030400 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-d10a811f-556f-44af-8374-fd3abfdcf1bd req-62471ed8-5ab2-42d9-b444-ee6797d88c49 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:29.043918 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-d10a811f-556f-44af-8374-fd3abfdcf1bd req-62471ed8-5ab2-42d9-b444-ee6797d88c49 service nova] Creating event network-vif-plugged:0a7f8a3d-0e85-4d9b-848c-60bc701c0f9b for instance fe46a662-3676-4164-a5f1-453182ddcb30 on hv-cinder-84488 Jul 12 18:38:29.048925 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-d10a811f-556f-44af-8374-fd3abfdcf1bd req-62471ed8-5ab2-42d9-b444-ee6797d88c49 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033105 Jul 12 18:38:29.049516 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 525/1007] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:38:29.164512 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6121ce72-d0e2-4d69-b145-b8a7f5e29b03 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:29.165131 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6121ce72-d0e2-4d69-b145-b8a7f5e29b03 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:29.167041 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:29.174299 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6121ce72-d0e2-4d69-b145-b8a7f5e29b03 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:29.174743 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6121ce72-d0e2-4d69-b145-b8a7f5e29b03 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:29.175532 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6121ce72-d0e2-4d69-b145-b8a7f5e29b03 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:29.175961 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6121ce72-d0e2-4d69-b145-b8a7f5e29b03 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:29.323733 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6121ce72-d0e2-4d69-b145-b8a7f5e29b03 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:29.331673 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6121ce72-d0e2-4d69-b145-b8a7f5e29b03 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1314 microversion: 2.1 time: 0.171743 Jul 12 18:38:29.332260 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 483/1008] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:29 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:30.351428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-97d35d50-4dc1-45e5-9cc9-fee8e5ff050c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:30.352145 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-97d35d50-4dc1-45e5-9cc9-fee8e5ff050c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:30.354071 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=37 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:30.359293 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97d35d50-4dc1-45e5-9cc9-fee8e5ff050c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:30.366576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97d35d50-4dc1-45e5-9cc9-fee8e5ff050c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:30.366576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97d35d50-4dc1-45e5-9cc9-fee8e5ff050c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:30.366576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-97d35d50-4dc1-45e5-9cc9-fee8e5ff050c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:30.501822 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-97d35d50-4dc1-45e5-9cc9-fee8e5ff050c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:30.509593 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-97d35d50-4dc1-45e5-9cc9-fee8e5ff050c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1314 microversion: 2.1 time: 0.163777 Jul 12 18:38:30.510171 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 526/1009] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:30 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:38:31.527752 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c6d37c53-0a67-440c-8044-53b377a074df tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:31.528400 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c6d37c53-0a67-440c-8044-53b377a074df tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:31.530194 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=8 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:31.535598 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6d37c53-0a67-440c-8044-53b377a074df tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:31.536028 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6d37c53-0a67-440c-8044-53b377a074df tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:31.536809 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6d37c53-0a67-440c-8044-53b377a074df tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:31.537240 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6d37c53-0a67-440c-8044-53b377a074df tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:31.681332 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c6d37c53-0a67-440c-8044-53b377a074df tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:31.695615 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c6d37c53-0a67-440c-8044-53b377a074df tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1497 microversion: 2.1 time: 0.171670 Jul 12 18:38:31.696639 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 484/1010] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:31 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:32.633376 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-bf9de3d2-2250-43d5-9b48-9c45d8eeda58 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:32.633960 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-bf9de3d2-2250-43d5-9b48-9c45d8eeda58 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:32.640749 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bf9de3d2-2250-43d5-9b48-9c45d8eeda58 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:32.641214 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bf9de3d2-2250-43d5-9b48-9c45d8eeda58 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:32.641982 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bf9de3d2-2250-43d5-9b48-9c45d8eeda58 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:32.642408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-bf9de3d2-2250-43d5-9b48-9c45d8eeda58 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:32.669905 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-bf9de3d2-2250-43d5-9b48-9c45d8eeda58 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:38:32.984456 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-bf9de3d2-2250-43d5-9b48-9c45d8eeda58 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 204 len: 0 microversion: 2.1 time: 0.355127 Jul 12 18:38:32.985050 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 527/1011] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:38:32 2022] DELETE /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:38:32.993852 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-99582bf3-7108-4f0f-b5a5-0f38142e1aca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:32.994525 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-99582bf3-7108-4f0f-b5a5-0f38142e1aca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:33.001605 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-99582bf3-7108-4f0f-b5a5-0f38142e1aca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:33.002078 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-99582bf3-7108-4f0f-b5a5-0f38142e1aca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:33.002853 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-99582bf3-7108-4f0f-b5a5-0f38142e1aca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:33.003284 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-99582bf3-7108-4f0f-b5a5-0f38142e1aca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:33.146712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-99582bf3-7108-4f0f-b5a5-0f38142e1aca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:33.154615 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-99582bf3-7108-4f0f-b5a5-0f38142e1aca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1503 microversion: 2.1 time: 0.165198 Jul 12 18:38:33.155202 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 485/1012] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:32 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:34.171717 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0511c7f0-b1a7-4943-9b28-3e2dccbdbcdc tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:34.172482 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0511c7f0-b1a7-4943-9b28-3e2dccbdbcdc tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:34.182935 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0511c7f0-b1a7-4943-9b28-3e2dccbdbcdc tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:34.183465 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0511c7f0-b1a7-4943-9b28-3e2dccbdbcdc tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:34.184296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0511c7f0-b1a7-4943-9b28-3e2dccbdbcdc tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:34.184942 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0511c7f0-b1a7-4943-9b28-3e2dccbdbcdc tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:34.187916 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:34.336424 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0511c7f0-b1a7-4943-9b28-3e2dccbdbcdc tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:34.344064 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0511c7f0-b1a7-4943-9b28-3e2dccbdbcdc tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1503 microversion: 2.1 time: 0.176591 Jul 12 18:38:34.344671 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 528/1013] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:34 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:35.156258 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-5b7fcda5-9a08-45c6-b98d-7cf4c1a4611f req-aa04ceaf-f6bb-422e-8fd8-7c08a9086c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe46a662-3676-4164-a5f1-453182ddcb30", "name": "network-vif-deleted", "tag": "0a7f8a3d-0e85-4d9b-848c-60bc701c0f9b"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:38:35.170977 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-5b7fcda5-9a08-45c6-b98d-7cf4c1a4611f req-aa04ceaf-f6bb-422e-8fd8-7c08a9086c5d service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:35.171656 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-5b7fcda5-9a08-45c6-b98d-7cf4c1a4611f req-aa04ceaf-f6bb-422e-8fd8-7c08a9086c5d service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:35.189214 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-5b7fcda5-9a08-45c6-b98d-7cf4c1a4611f req-aa04ceaf-f6bb-422e-8fd8-7c08a9086c5d service nova] Creating event network-vif-deleted:0a7f8a3d-0e85-4d9b-848c-60bc701c0f9b for instance fe46a662-3676-4164-a5f1-453182ddcb30 on hv-cinder-84488 Jul 12 18:38:35.195554 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-5b7fcda5-9a08-45c6-b98d-7cf4c1a4611f req-aa04ceaf-f6bb-422e-8fd8-7c08a9086c5d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046688 Jul 12 18:38:35.196535 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 486/1014] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:38:35.363072 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c8704b11-aa89-4791-b4fa-c7463b40da96 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:35.363636 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c8704b11-aa89-4791-b4fa-c7463b40da96 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:35.370972 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c8704b11-aa89-4791-b4fa-c7463b40da96 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:35.371499 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c8704b11-aa89-4791-b4fa-c7463b40da96 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:35.372615 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c8704b11-aa89-4791-b4fa-c7463b40da96 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:35.373088 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c8704b11-aa89-4791-b4fa-c7463b40da96 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:35.445931 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c8704b11-aa89-4791-b4fa-c7463b40da96 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:35.456794 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c8704b11-aa89-4791-b4fa-c7463b40da96 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1299 microversion: 2.1 time: 0.098754 Jul 12 18:38:35.457407 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 529/1015] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:35 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:38:36.475866 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-df817aaa-08d3-420c-88ac-d20d6f2064b6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:36.476572 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-df817aaa-08d3-420c-88ac-d20d6f2064b6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:36.482755 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-df817aaa-08d3-420c-88ac-d20d6f2064b6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:36.483194 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-df817aaa-08d3-420c-88ac-d20d6f2064b6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:36.483944 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-df817aaa-08d3-420c-88ac-d20d6f2064b6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:36.484398 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-df817aaa-08d3-420c-88ac-d20d6f2064b6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:36.517115 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-df817aaa-08d3-420c-88ac-d20d6f2064b6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:36.517567 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-df817aaa-08d3-420c-88ac-d20d6f2064b6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:36.518022 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-df817aaa-08d3-420c-88ac-d20d6f2064b6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lazy-loading 'fault' on Instance uuid fe46a662-3676-4164-a5f1-453182ddcb30 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:38:36.561489 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-df817aaa-08d3-420c-88ac-d20d6f2064b6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:36.569110 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-df817aaa-08d3-420c-88ac-d20d6f2064b6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 200 len: 1304 microversion: 2.1 time: 0.098249 Jul 12 18:38:36.569691 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 487/1016] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:36 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:37.587069 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-461aeb5b-68ec-4b09-971f-cdba4f478701 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:37.587709 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-461aeb5b-68ec-4b09-971f-cdba4f478701 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: fe46a662-3676-4164-a5f1-453182ddcb30] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:37.594250 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-461aeb5b-68ec-4b09-971f-cdba4f478701 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:37.594702 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-461aeb5b-68ec-4b09-971f-cdba4f478701 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:37.595466 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-461aeb5b-68ec-4b09-971f-cdba4f478701 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:37.595897 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-461aeb5b-68ec-4b09-971f-cdba4f478701 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:37.610330 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-461aeb5b-68ec-4b09-971f-cdba4f478701 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] HTTP exception thrown: Instance fe46a662-3676-4164-a5f1-453182ddcb30 could not be found. Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-461aeb5b-68ec-4b09-971f-cdba4f478701 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Request method failure captured: Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 HTTP/1.1 Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb-XrmX5VxEdFHpl844uvNe4IajltSFjNYMbP5BR1RsaUutSDME-vatGB3R4bgLFURSKgRamv90Vtu3-Z_0_T8HS1SN-VoHTidCCPlF9w0oaKOLo56ul3LbX8udRkaSXPP0_BGH_f3FuZM6YHNLfXpMCBArfPq5nSD7Nequev16FUp0 Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 072667f3650243fc9973a36efad7ae1d Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-VolumesActionsTest-869837170 Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:38:37.612044 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/072667f3650243fc9973a36efad7ae1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/072667f3650243fc9973a36efad7ae1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_072667f3650243fc9973a36efad7ae1d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/072667f3650243fc9973a36efad7ae1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-VolumesActionsTest-869837170 Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 072667f3650243fc9973a36efad7ae1d Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-VolumesActionsTest-869837170 Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-VolumesActionsTest-869837170-project Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 84f9e5a76bbe4dcf906a1b46f53fa7c3 Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-VolumesActionsTest-869837170-project Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance fe46a662-3676-4164-a5f1-453182ddcb30 could not be found. Jul 12 18:38:37.613821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': 'fe46a662-3676-4164-a5f1-453182ddcb30'} Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe46a662-3676-4164-a5f1-453182ddcb30 could not be found. Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:38:37.614828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe46a662-3676-4164-a5f1-453182ddcb30 could not be found. Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe46a662-3676-4164-a5f1-453182ddcb30 could not be found. Jul 12 18:38:37.616544 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:38:37.617994 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-461aeb5b-68ec-4b09-971f-cdba4f478701 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Returning 404 to user: Instance fe46a662-3676-4164-a5f1-453182ddcb30 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:38:37.617994 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-461aeb5b-68ec-4b09-971f-cdba4f478701 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30" status: 404 len: 111 microversion: 2.1 time: 0.031116 Jul 12 18:38:37.617994 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 530/1017] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:37 2022] GET /compute/v2.1/servers/fe46a662-3676-4164-a5f1-453182ddcb30 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:38:37.662604 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1449761980", "imageRef": "40e96749-9bae-47e0-86aa-1a142ed33594", "flavorRef": "452", "networks": [{"uuid": "12e5935b-73da-4ad9-90cb-8253ca02a9ca"}]}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:38:37.713965 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] validate_networks() for [('12e5935b-73da-4ad9-90cb-8253ca02a9ca', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:38:38.063922 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:38:38.064361 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:38:38.064830 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:38:38.065231 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:38:38.065633 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:38:38.075103 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:38.075509 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:38.076299 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:38.076769 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:38.093874 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Getting quotas for project 072667f3650243fc9973a36efad7ae1d. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:38:38.097768 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Getting quotas for user 84f9e5a76bbe4dcf906a1b46f53fa7c3 and project 072667f3650243fc9973a36efad7ae1d. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:38:38.108641 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:38:38.110923 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40e96749-9bae-47e0-86aa-1a142ed33594',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:38:38.219206 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-13e91d8b-11f9-4b62-8e5a-5f2479cd34e0 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560425 Jul 12 18:38:38.219779 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 488/1018] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:38:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:38:38.229919 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-3408f0ba-218f-4701-a532-999f56f2dd49 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:38.230534 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-3408f0ba-218f-4701-a532-999f56f2dd49 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:38.289690 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-3408f0ba-218f-4701-a532-999f56f2dd49 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:38.296527 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-3408f0ba-218f-4701-a532-999f56f2dd49 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1214 microversion: 2.1 time: 0.070387 Jul 12 18:38:38.297105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 531/1019] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:38 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:39.315135 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-117f5b28-a132-42d2-9d28-fde34b2795ca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:39.315724 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-117f5b28-a132-42d2-9d28-fde34b2795ca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:39.326003 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-117f5b28-a132-42d2-9d28-fde34b2795ca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:39.326472 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-117f5b28-a132-42d2-9d28-fde34b2795ca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:39.327244 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-117f5b28-a132-42d2-9d28-fde34b2795ca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:39.327666 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-117f5b28-a132-42d2-9d28-fde34b2795ca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:39.393057 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-117f5b28-a132-42d2-9d28-fde34b2795ca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:39.401576 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-117f5b28-a132-42d2-9d28-fde34b2795ca tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1218 microversion: 2.1 time: 0.090841 Jul 12 18:38:39.402145 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 489/1020] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:39 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:40.420239 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fbacef5c-7734-4e84-aba0-56fea6543da6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:40.421067 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fbacef5c-7734-4e84-aba0-56fea6543da6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:40.428787 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbacef5c-7734-4e84-aba0-56fea6543da6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:40.429238 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbacef5c-7734-4e84-aba0-56fea6543da6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:40.430008 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbacef5c-7734-4e84-aba0-56fea6543da6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:40.430659 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fbacef5c-7734-4e84-aba0-56fea6543da6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:40.501556 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fbacef5c-7734-4e84-aba0-56fea6543da6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:40.510301 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fbacef5c-7734-4e84-aba0-56fea6543da6 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1274 microversion: 2.1 time: 0.094894 Jul 12 18:38:40.520581 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 532/1021] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:40 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:41.527273 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-da62bcda-9ce2-4bd9-966a-16cb80ac4272 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:41.527989 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-da62bcda-9ce2-4bd9-966a-16cb80ac4272 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:41.534547 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da62bcda-9ce2-4bd9-966a-16cb80ac4272 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:41.535031 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da62bcda-9ce2-4bd9-966a-16cb80ac4272 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:41.535843 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da62bcda-9ce2-4bd9-966a-16cb80ac4272 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:41.536277 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da62bcda-9ce2-4bd9-966a-16cb80ac4272 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:41.701810 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-da62bcda-9ce2-4bd9-966a-16cb80ac4272 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:41.709795 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-da62bcda-9ce2-4bd9-966a-16cb80ac4272 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1314 microversion: 2.1 time: 0.186643 Jul 12 18:38:41.710372 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 490/1022] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:41 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:42.057332 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-58773e1c-bae6-4720-ac0f-6303e5015ef1 req-54df0f61-ca59-4a52-a7f8-6cc8c05fc258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d9bd08-80fc-4216-ac93-4d97a5950f90", "tag": "a4c8a89e-84a1-4ffe-9459-6a5ca3ea6e23"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:38:42.067494 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-58773e1c-bae6-4720-ac0f-6303e5015ef1 req-54df0f61-ca59-4a52-a7f8-6cc8c05fc258 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:42.068037 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-58773e1c-bae6-4720-ac0f-6303e5015ef1 req-54df0f61-ca59-4a52-a7f8-6cc8c05fc258 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:42.080886 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-58773e1c-bae6-4720-ac0f-6303e5015ef1 req-54df0f61-ca59-4a52-a7f8-6cc8c05fc258 service nova] Creating event network-changed:a4c8a89e-84a1-4ffe-9459-6a5ca3ea6e23 for instance e2d9bd08-80fc-4216-ac93-4d97a5950f90 on hv-cinder-84488 Jul 12 18:38:42.086402 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-58773e1c-bae6-4720-ac0f-6303e5015ef1 req-54df0f61-ca59-4a52-a7f8-6cc8c05fc258 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034322 Jul 12 18:38:42.087052 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 533/1023] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:38:42.726928 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-59abe9bf-39de-4285-9614-98174cd7f69c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:42.728185 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-59abe9bf-39de-4285-9614-98174cd7f69c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:42.735117 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59abe9bf-39de-4285-9614-98174cd7f69c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:42.735567 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59abe9bf-39de-4285-9614-98174cd7f69c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:42.736380 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59abe9bf-39de-4285-9614-98174cd7f69c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:42.736822 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59abe9bf-39de-4285-9614-98174cd7f69c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:42.914676 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-59abe9bf-39de-4285-9614-98174cd7f69c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:42.923876 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-59abe9bf-39de-4285-9614-98174cd7f69c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1314 microversion: 2.1 time: 0.200585 Jul 12 18:38:42.924664 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 491/1024] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:42 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:43.942587 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ce301d6a-e79a-4549-9d14-53250818a42f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:43.943286 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ce301d6a-e79a-4549-9d14-53250818a42f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:43.950258 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ce301d6a-e79a-4549-9d14-53250818a42f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:43.950703 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ce301d6a-e79a-4549-9d14-53250818a42f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:43.951462 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ce301d6a-e79a-4549-9d14-53250818a42f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:43.951896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ce301d6a-e79a-4549-9d14-53250818a42f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:44.082921 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ce301d6a-e79a-4549-9d14-53250818a42f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:44.090805 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ce301d6a-e79a-4549-9d14-53250818a42f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1314 microversion: 2.1 time: 0.152974 Jul 12 18:38:44.091355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 534/1025] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:43 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:45.108102 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b5ef12cf-ac45-4699-a6e8-566043e10fff tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:45.108763 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b5ef12cf-ac45-4699-a6e8-566043e10fff tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:45.116227 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5ef12cf-ac45-4699-a6e8-566043e10fff tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:45.116687 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5ef12cf-ac45-4699-a6e8-566043e10fff tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:45.117497 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5ef12cf-ac45-4699-a6e8-566043e10fff tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:45.117962 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5ef12cf-ac45-4699-a6e8-566043e10fff tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:45.259428 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b5ef12cf-ac45-4699-a6e8-566043e10fff tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:45.267245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b5ef12cf-ac45-4699-a6e8-566043e10fff tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1314 microversion: 2.1 time: 0.163849 Jul 12 18:38:45.267833 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 492/1026] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:45 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:46.284300 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c83ba38c-84e4-4502-b1dd-325451a8dbb9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:46.284948 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c83ba38c-84e4-4502-b1dd-325451a8dbb9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:46.291660 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c83ba38c-84e4-4502-b1dd-325451a8dbb9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:46.292107 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c83ba38c-84e4-4502-b1dd-325451a8dbb9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:46.292911 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c83ba38c-84e4-4502-b1dd-325451a8dbb9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:46.293346 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c83ba38c-84e4-4502-b1dd-325451a8dbb9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:46.427813 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c83ba38c-84e4-4502-b1dd-325451a8dbb9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:46.437004 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c83ba38c-84e4-4502-b1dd-325451a8dbb9 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1314 microversion: 2.1 time: 0.156573 Jul 12 18:38:46.437567 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 535/1027] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:46 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:38:47.458385 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8b93a27e-7f1b-4ecf-8d2c-9bc6ba352740 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:47.459007 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8b93a27e-7f1b-4ecf-8d2c-9bc6ba352740 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:47.466313 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8b93a27e-7f1b-4ecf-8d2c-9bc6ba352740 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:47.466882 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8b93a27e-7f1b-4ecf-8d2c-9bc6ba352740 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:47.467841 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8b93a27e-7f1b-4ecf-8d2c-9bc6ba352740 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:47.468530 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8b93a27e-7f1b-4ecf-8d2c-9bc6ba352740 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:47.604825 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8b93a27e-7f1b-4ecf-8d2c-9bc6ba352740 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:47.613001 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8b93a27e-7f1b-4ecf-8d2c-9bc6ba352740 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1314 microversion: 2.1 time: 0.160941 Jul 12 18:38:47.613599 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 493/1028] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:47 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:48.638618 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5d932f1f-1af3-4c60-96ab-f9f780fab816 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:48.639234 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5d932f1f-1af3-4c60-96ab-f9f780fab816 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:48.641633 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:48.646468 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d932f1f-1af3-4c60-96ab-f9f780fab816 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:48.646911 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d932f1f-1af3-4c60-96ab-f9f780fab816 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:48.647759 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d932f1f-1af3-4c60-96ab-f9f780fab816 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:48.648198 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d932f1f-1af3-4c60-96ab-f9f780fab816 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:48.778943 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5d932f1f-1af3-4c60-96ab-f9f780fab816 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:48.786452 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5d932f1f-1af3-4c60-96ab-f9f780fab816 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1314 microversion: 2.1 time: 0.151782 Jul 12 18:38:48.787019 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 536/1029] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:48 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:49.119824 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-3e19e50f-4dcc-47a5-91ba-b64e823e01dc req-4495facc-98de-42b5-b201-2a740e5f060b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d9bd08-80fc-4216-ac93-4d97a5950f90", "name": "network-vif-plugged", "status": "completed", "tag": "a4c8a89e-84a1-4ffe-9459-6a5ca3ea6e23"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:38:49.124065 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:49.124754 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:38:49.130715 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-3e19e50f-4dcc-47a5-91ba-b64e823e01dc req-4495facc-98de-42b5-b201-2a740e5f060b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:49.131158 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-3e19e50f-4dcc-47a5-91ba-b64e823e01dc req-4495facc-98de-42b5-b201-2a740e5f060b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:49.143360 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-3e19e50f-4dcc-47a5-91ba-b64e823e01dc req-4495facc-98de-42b5-b201-2a740e5f060b service nova] Creating event network-vif-plugged:a4c8a89e-84a1-4ffe-9459-6a5ca3ea6e23 for instance e2d9bd08-80fc-4216-ac93-4d97a5950f90 on hv-cinder-84488 Jul 12 18:38:49.148818 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-3e19e50f-4dcc-47a5-91ba-b64e823e01dc req-4495facc-98de-42b5-b201-2a740e5f060b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033671 Jul 12 18:38:49.149623 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 494/1030] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:38:49.803601 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-592dcef0-f3a1-45b3-8cab-4c21a44a8e9f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:49.804139 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-592dcef0-f3a1-45b3-8cab-4c21a44a8e9f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:49.811469 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-592dcef0-f3a1-45b3-8cab-4c21a44a8e9f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:49.811919 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-592dcef0-f3a1-45b3-8cab-4c21a44a8e9f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:49.812722 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-592dcef0-f3a1-45b3-8cab-4c21a44a8e9f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:49.813161 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-592dcef0-f3a1-45b3-8cab-4c21a44a8e9f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:49.951498 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-592dcef0-f3a1-45b3-8cab-4c21a44a8e9f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:49.958930 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-592dcef0-f3a1-45b3-8cab-4c21a44a8e9f tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1314 microversion: 2.1 time: 0.159336 Jul 12 18:38:49.959510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 537/1031] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:49 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:50.977106 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-70f9ab54-ef50-4dae-bfa2-87619734f82b tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:50.978268 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-70f9ab54-ef50-4dae-bfa2-87619734f82b tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:50.985426 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70f9ab54-ef50-4dae-bfa2-87619734f82b tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:50.985877 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70f9ab54-ef50-4dae-bfa2-87619734f82b tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:50.986650 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70f9ab54-ef50-4dae-bfa2-87619734f82b tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:50.987103 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70f9ab54-ef50-4dae-bfa2-87619734f82b tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:51.136567 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-70f9ab54-ef50-4dae-bfa2-87619734f82b tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:51.144614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-70f9ab54-ef50-4dae-bfa2-87619734f82b tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1497 microversion: 2.1 time: 0.172401 Jul 12 18:38:51.145219 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 495/1032] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:50 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:51.996910 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ef6399b9-3654-4a87-be80-c0aa800fb90c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:51.997720 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ef6399b9-3654-4a87-be80-c0aa800fb90c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:52.004174 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ef6399b9-3654-4a87-be80-c0aa800fb90c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:52.004649 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ef6399b9-3654-4a87-be80-c0aa800fb90c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:52.005405 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ef6399b9-3654-4a87-be80-c0aa800fb90c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:52.005864 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ef6399b9-3654-4a87-be80-c0aa800fb90c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:52.034949 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ef6399b9-3654-4a87-be80-c0aa800fb90c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:38:52.315011 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ef6399b9-3654-4a87-be80-c0aa800fb90c tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 204 len: 0 microversion: 2.1 time: 0.322453 Jul 12 18:38:52.315510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 538/1033] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:38:51 2022] DELETE /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:38:52.323982 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7868162a-8cc1-43c8-9585-2cb336faa283 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:52.324650 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7868162a-8cc1-43c8-9585-2cb336faa283 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:52.331399 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7868162a-8cc1-43c8-9585-2cb336faa283 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:52.331849 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7868162a-8cc1-43c8-9585-2cb336faa283 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:52.332642 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7868162a-8cc1-43c8-9585-2cb336faa283 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:52.333073 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7868162a-8cc1-43c8-9585-2cb336faa283 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:52.470353 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7868162a-8cc1-43c8-9585-2cb336faa283 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:52.479210 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7868162a-8cc1-43c8-9585-2cb336faa283 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1503 microversion: 2.1 time: 0.159246 Jul 12 18:38:52.479811 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 496/1034] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:52 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:53.497830 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-85f60573-2c66-4f2b-bbaf-1cdd1995089a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:53.498528 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-85f60573-2c66-4f2b-bbaf-1cdd1995089a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:53.504643 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-85f60573-2c66-4f2b-bbaf-1cdd1995089a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:53.505089 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-85f60573-2c66-4f2b-bbaf-1cdd1995089a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:53.505881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-85f60573-2c66-4f2b-bbaf-1cdd1995089a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:53.506315 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-85f60573-2c66-4f2b-bbaf-1cdd1995089a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:53.646660 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-85f60573-2c66-4f2b-bbaf-1cdd1995089a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:53.654840 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-85f60573-2c66-4f2b-bbaf-1cdd1995089a tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1503 microversion: 2.1 time: 0.161704 Jul 12 18:38:53.655404 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 539/1035] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:53 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:54.350598 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-80e99eb9-9d60-46f5-bc05-aeae3e45ebae req-280f66eb-91ae-4e83-b15e-6ccb6f88b817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d9bd08-80fc-4216-ac93-4d97a5950f90", "name": "network-vif-deleted", "tag": "a4c8a89e-84a1-4ffe-9459-6a5ca3ea6e23"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:38:54.359260 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-80e99eb9-9d60-46f5-bc05-aeae3e45ebae req-280f66eb-91ae-4e83-b15e-6ccb6f88b817 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:54.364671 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-80e99eb9-9d60-46f5-bc05-aeae3e45ebae req-280f66eb-91ae-4e83-b15e-6ccb6f88b817 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:54.371892 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-80e99eb9-9d60-46f5-bc05-aeae3e45ebae req-280f66eb-91ae-4e83-b15e-6ccb6f88b817 service nova] Creating event network-vif-deleted:a4c8a89e-84a1-4ffe-9459-6a5ca3ea6e23 for instance e2d9bd08-80fc-4216-ac93-4d97a5950f90 on hv-cinder-84488 Jul 12 18:38:54.377358 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-80e99eb9-9d60-46f5-bc05-aeae3e45ebae req-280f66eb-91ae-4e83-b15e-6ccb6f88b817 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030357 Jul 12 18:38:54.377966 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 497/1036] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:38:54.671782 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c09111ef-37b9-4494-9214-7f095902ac73 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:54.677060 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c09111ef-37b9-4494-9214-7f095902ac73 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:54.679296 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c09111ef-37b9-4494-9214-7f095902ac73 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:54.679748 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c09111ef-37b9-4494-9214-7f095902ac73 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:54.680560 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c09111ef-37b9-4494-9214-7f095902ac73 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:54.680995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c09111ef-37b9-4494-9214-7f095902ac73 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:54.716141 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c09111ef-37b9-4494-9214-7f095902ac73 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:54.716615 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c09111ef-37b9-4494-9214-7f095902ac73 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:54.717065 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-c09111ef-37b9-4494-9214-7f095902ac73 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lazy-loading 'fault' on Instance uuid e2d9bd08-80fc-4216-ac93-4d97a5950f90 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:38:54.760491 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c09111ef-37b9-4494-9214-7f095902ac73 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f9e5a76bbe4dcf906a1b46f53fa7c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072667f3650243fc9973a36efad7ae1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:38:54.768381 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c09111ef-37b9-4494-9214-7f095902ac73 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 200 len: 1304 microversion: 2.1 time: 0.100481 Jul 12 18:38:54.768955 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 540/1037] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:54 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:38:55.793881 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3dc82fd8-7d4f-4e4d-a9d7-201901a815b1 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:55.794495 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3dc82fd8-7d4f-4e4d-a9d7-201901a815b1 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] [instance: e2d9bd08-80fc-4216-ac93-4d97a5950f90] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:38:55.800833 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3dc82fd8-7d4f-4e4d-a9d7-201901a815b1 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:55.801907 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3dc82fd8-7d4f-4e4d-a9d7-201901a815b1 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:55.802049 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3dc82fd8-7d4f-4e4d-a9d7-201901a815b1 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:55.802500 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3dc82fd8-7d4f-4e4d-a9d7-201901a815b1 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:55.817282 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-3dc82fd8-7d4f-4e4d-a9d7-201901a815b1 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] HTTP exception thrown: Instance e2d9bd08-80fc-4216-ac93-4d97a5950f90 could not be found. Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3dc82fd8-7d4f-4e4d-a9d7-201901a815b1 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Request method failure captured: Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 HTTP/1.1 Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb-XrmX5VxEdFHpl844uvNe4IajltSFjNYMbP5BR1RsaUutSDME-vatGB3R4bgLFURSKgRamv90Vtu3-Z_0_T8HS1SN-VoHTidCCPlF9w0oaKOLo56ul3LbX8udRkaSXPP0_BGH_f3FuZM6YHNLfXpMCBArfPq5nSD7Nequev16FUp0 Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 072667f3650243fc9973a36efad7ae1d Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesActionsTest-869837170 Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:38:55.818956 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/072667f3650243fc9973a36efad7ae1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/072667f3650243fc9973a36efad7ae1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_072667f3650243fc9973a36efad7ae1d", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/072667f3650243fc9973a36efad7ae1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesActionsTest-869837170 Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 072667f3650243fc9973a36efad7ae1d Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesActionsTest-869837170 Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesActionsTest-869837170-project Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 84f9e5a76bbe4dcf906a1b46f53fa7c3 Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesActionsTest-869837170-project Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance e2d9bd08-80fc-4216-ac93-4d97a5950f90 could not be found. Jul 12 18:38:55.820832 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': 'e2d9bd08-80fc-4216-ac93-4d97a5950f90'} Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d9bd08-80fc-4216-ac93-4d97a5950f90 could not be found. Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:38:55.821802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d9bd08-80fc-4216-ac93-4d97a5950f90 could not be found. Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d9bd08-80fc-4216-ac93-4d97a5950f90 could not be found. Jul 12 18:38:55.824104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:38:55.826150 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3dc82fd8-7d4f-4e4d-a9d7-201901a815b1 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] Returning 404 to user: Instance e2d9bd08-80fc-4216-ac93-4d97a5950f90 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:38:55.826150 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3dc82fd8-7d4f-4e4d-a9d7-201901a815b1 tempest-VolumesActionsTest-869837170 tempest-VolumesActionsTest-869837170-project] 10.222.0.47 "GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90" status: 404 len: 111 microversion: 2.1 time: 0.032431 Jul 12 18:38:55.826150 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 498/1038] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:38:55 2022] GET /compute/v2.1/servers/e2d9bd08-80fc-4216-ac93-4d97a5950f90 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:39:36.346708 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:39:36.347574 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:39:36.520138 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-d4b106fd-aee4-41a5-ad84-9f0c8426d27f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Action: 'create', calling method: .version_select at 0x7f1bb09134c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-862531149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvngSa4pPjGPvIzV0WNvO+/vfcjNV2dFTKGyoTPK+oNiDMtDPqlnh1iL8E611TM2SrxmoLmgOwf/BFIAQItY3+K8m/vB+3jcTluqobmI34uOLUMCtiIC1gICz0qQWKwVA=="}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:39:36.534863 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-d4b106fd-aee4-41a5-ad84-9f0c8426d27f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Getting quotas for project cbb64781270b435aaf0eb5e2c4d290b0. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:39:36.538648 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.quota [None req-d4b106fd-aee4-41a5-ad84-9f0c8426d27f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Getting quotas for user 11c8efca90fa4e309ada93f3eecda4cc and project cbb64781270b435aaf0eb5e2c4d290b0. Resources: {'key_pairs'} {{(pid=118411) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:39:36.607194 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-d4b106fd-aee4-41a5-ad84-9f0c8426d27f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.265416 Jul 12 18:39:36.607712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 541/1039] 10.222.0.47 () {60 vars in 1158 bytes} [Tue Jul 12 18:39:36 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:39:54.923551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2001150876", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-862531149", "security_groups": [{"name": "tempest-secgroup-smoke-1633788743"}], "networks": [{"uuid": "8c7e38a8-d10f-4f62-a564-9feee2605137"}], "block_device_mapping_v2": [{"uuid": "fed8ac33-2b1c-4d7b-99b7-5f796239eed7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:39:54.932206 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:39:54.932881 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=83 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:39:55.050260 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] validate_networks() for [('8c7e38a8-d10f-4f62-a564-9feee2605137', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:39:55.452872 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:39:55.453280 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:39:55.453744 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:39:55.454144 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:39:55.454539 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:39:55.464284 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:55.464754 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:55.465542 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:55.465967 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:55.482942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Getting quotas for project cbb64781270b435aaf0eb5e2c4d290b0. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:39:55.487072 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Getting quotas for user 11c8efca90fa4e309ada93f3eecda4cc and project cbb64781270b435aaf0eb5e2c4d290b0. Resources: {'instances', 'ram', 'cores'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:39:55.556550 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:39:55.559900 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fed8ac33-2b1c-4d7b-99b7-5f796239eed7',volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:39:56.047303 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6a4a91db-2af8-432e-81fe-ecdd5ab2d5c7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.127932 Jul 12 18:39:56.048566 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 499/1040] 10.222.0.47 () {60 vars in 1146 bytes} [Tue Jul 12 18:39:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:39:56.058608 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=4 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:39:56.060176 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:39:56.066531 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-441080b9-eeb3-432c-806c-2dfe77a1be69 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:39:56.070894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-441080b9-eeb3-432c-806c-2dfe77a1be69 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:39:56.137246 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-441080b9-eeb3-432c-806c-2dfe77a1be69 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:39:56.145698 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-441080b9-eeb3-432c-806c-2dfe77a1be69 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1088 microversion: 2.1 time: 0.090001 Jul 12 18:39:56.146266 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 542/1041] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:39:56 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1088 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:39:57.168157 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9a40a1b0-7bf4-44cb-b3d6-7c287261551e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:39:57.169396 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9a40a1b0-7bf4-44cb-b3d6-7c287261551e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:39:57.258802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9a40a1b0-7bf4-44cb-b3d6-7c287261551e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:39:57.271598 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9a40a1b0-7bf4-44cb-b3d6-7c287261551e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1088 microversion: 2.1 time: 0.107636 Jul 12 18:39:57.272690 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 500/1042] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:39:57 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1088 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:39:57.463557 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1c03ed3c-8cb1-491c-a848-758df99ddb63 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:39:57.464504 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1c03ed3c-8cb1-491c-a848-758df99ddb63 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:39:57.467501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-9c3780f6-c99a-444e-b461-390d5058a7be req-d98fc5ad-3541-4065-924a-ea8cfd203da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a4ad3d-1558-4562-9b6b-10d350b59196", "tag": "afa4b915-f2c7-480d-8f6b-2fe0fe884075"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:39:57.473537 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1c03ed3c-8cb1-491c-a848-758df99ddb63 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:57.474326 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1c03ed3c-8cb1-491c-a848-758df99ddb63 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:57.475337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1c03ed3c-8cb1-491c-a848-758df99ddb63 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:57.476023 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1c03ed3c-8cb1-491c-a848-758df99ddb63 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:57.481260 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-9c3780f6-c99a-444e-b461-390d5058a7be req-d98fc5ad-3541-4065-924a-ea8cfd203da2 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:57.485197 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-9c3780f6-c99a-444e-b461-390d5058a7be req-d98fc5ad-3541-4065-924a-ea8cfd203da2 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:57.503489 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-9c3780f6-c99a-444e-b461-390d5058a7be req-d98fc5ad-3541-4065-924a-ea8cfd203da2 service nova] Creating event network-changed:afa4b915-f2c7-480d-8f6b-2fe0fe884075 for instance a5a4ad3d-1558-4562-9b6b-10d350b59196 on hv-cinder-84488 Jul 12 18:39:57.513770 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1c03ed3c-8cb1-491c-a848-758df99ddb63 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Going to try to terminate instance {{(pid=118411) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:39:57.514087 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-9c3780f6-c99a-444e-b461-390d5058a7be req-d98fc5ad-3541-4065-924a-ea8cfd203da2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058760 Jul 12 18:39:57.514762 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 501/1043] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:39:57.811294 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1c03ed3c-8cb1-491c-a848-758df99ddb63 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 204 len: 0 microversion: 2.1 time: 0.362722 Jul 12 18:39:57.815707 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 543/1044] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:39:57 2022] DELETE /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:39:57.823703 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c07b1177-d177-40a8-9839-cff93dbeaa8a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:39:57.824496 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c07b1177-d177-40a8-9839-cff93dbeaa8a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:39:57.834636 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c07b1177-d177-40a8-9839-cff93dbeaa8a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:57.835866 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c07b1177-d177-40a8-9839-cff93dbeaa8a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:57.838885 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c07b1177-d177-40a8-9839-cff93dbeaa8a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:57.840020 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c07b1177-d177-40a8-9839-cff93dbeaa8a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:58.017817 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c07b1177-d177-40a8-9839-cff93dbeaa8a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:39:58.027268 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c07b1177-d177-40a8-9839-cff93dbeaa8a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1576 microversion: 2.1 time: 0.209111 Jul 12 18:39:58.027689 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 502/1045] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:39:57 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:39:58.295742 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-48333a85-2c86-479c-89a2-7261a52bbc66 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:39:58.296488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-48333a85-2c86-479c-89a2-7261a52bbc66 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:39:58.302527 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-48333a85-2c86-479c-89a2-7261a52bbc66 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:58.303076 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-48333a85-2c86-479c-89a2-7261a52bbc66 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:58.303786 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-48333a85-2c86-479c-89a2-7261a52bbc66 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:58.304216 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-48333a85-2c86-479c-89a2-7261a52bbc66 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:58.374897 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-48333a85-2c86-479c-89a2-7261a52bbc66 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:39:58.383089 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-48333a85-2c86-479c-89a2-7261a52bbc66 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1186 microversion: 2.1 time: 0.092947 Jul 12 18:39:58.383856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 544/1046] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:39:58 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1186 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:39:59.089767 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fa21afd8-4d53-42a2-9c94-555a2e7bbfb3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:39:59.089767 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fa21afd8-4d53-42a2-9c94-555a2e7bbfb3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:39:59.089767 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa21afd8-4d53-42a2-9c94-555a2e7bbfb3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:59.089767 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa21afd8-4d53-42a2-9c94-555a2e7bbfb3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:59.090943 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa21afd8-4d53-42a2-9c94-555a2e7bbfb3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:59.090943 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa21afd8-4d53-42a2-9c94-555a2e7bbfb3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:59.289179 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fa21afd8-4d53-42a2-9c94-555a2e7bbfb3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:39:59.298141 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fa21afd8-4d53-42a2-9c94-555a2e7bbfb3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1576 microversion: 2.1 time: 0.250343 Jul 12 18:39:59.298723 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 503/1047] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:39:59 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:39:59.402880 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-23316c4a-9039-4a9a-88b5-0d719e49a551 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:39:59.403676 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-23316c4a-9039-4a9a-88b5-0d719e49a551 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:39:59.410455 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-23316c4a-9039-4a9a-88b5-0d719e49a551 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:59.410976 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-23316c4a-9039-4a9a-88b5-0d719e49a551 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:59.411762 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-23316c4a-9039-4a9a-88b5-0d719e49a551 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:39:59.412201 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-23316c4a-9039-4a9a-88b5-0d719e49a551 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:39:59.491526 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-23316c4a-9039-4a9a-88b5-0d719e49a551 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:39:59.500355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-23316c4a-9039-4a9a-88b5-0d719e49a551 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1186 microversion: 2.1 time: 0.102771 Jul 12 18:39:59.500946 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 545/1048] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:39:59 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:00.317954 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7b4cdc6d-cf7d-49d3-9764-f2e50e25ebd3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:00.318568 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7b4cdc6d-cf7d-49d3-9764-f2e50e25ebd3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:00.326486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b4cdc6d-cf7d-49d3-9764-f2e50e25ebd3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:00.327019 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b4cdc6d-cf7d-49d3-9764-f2e50e25ebd3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:00.327884 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b4cdc6d-cf7d-49d3-9764-f2e50e25ebd3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:00.328965 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b4cdc6d-cf7d-49d3-9764-f2e50e25ebd3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:00.521496 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-ca18985e-6695-4a06-a77e-3fea87de5d0d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:00.522590 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-ca18985e-6695-4a06-a77e-3fea87de5d0d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:00.531943 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ca18985e-6695-4a06-a77e-3fea87de5d0d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:00.532601 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ca18985e-6695-4a06-a77e-3fea87de5d0d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:00.533956 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ca18985e-6695-4a06-a77e-3fea87de5d0d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:00.534537 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-ca18985e-6695-4a06-a77e-3fea87de5d0d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:00.630138 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-ca18985e-6695-4a06-a77e-3fea87de5d0d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:00.644103 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-ca18985e-6695-4a06-a77e-3fea87de5d0d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1204 microversion: 2.1 time: 0.128251 Jul 12 18:40:00.645583 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 546/1049] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:00 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1204 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:40:00.655764 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7b4cdc6d-cf7d-49d3-9764-f2e50e25ebd3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:00.656276 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-d869595d-2fbc-44f6-9442-dcb2c20b9351 req-cb7ff4f4-c8a1-4ddf-b93c-ec13074ea25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a4ad3d-1558-4562-9b6b-10d350b59196", "name": "network-vif-deleted", "tag": "afa4b915-f2c7-480d-8f6b-2fe0fe884075"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:00.671448 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-d869595d-2fbc-44f6-9442-dcb2c20b9351 req-cb7ff4f4-c8a1-4ddf-b93c-ec13074ea25d service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:00.672184 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-d869595d-2fbc-44f6-9442-dcb2c20b9351 req-cb7ff4f4-c8a1-4ddf-b93c-ec13074ea25d service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:00.675550 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7b4cdc6d-cf7d-49d3-9764-f2e50e25ebd3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1457 microversion: 2.1 time: 0.361839 Jul 12 18:40:00.689943 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-d869595d-2fbc-44f6-9442-dcb2c20b9351 req-cb7ff4f4-c8a1-4ddf-b93c-ec13074ea25d service nova] Creating event network-vif-deleted:afa4b915-f2c7-480d-8f6b-2fe0fe884075 for instance a5a4ad3d-1558-4562-9b6b-10d350b59196 on hv-cinder-84488 Jul 12 18:40:00.690143 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 504/1050] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:00 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1457 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:00.695346 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-d869595d-2fbc-44f6-9442-dcb2c20b9351 req-cb7ff4f4-c8a1-4ddf-b93c-ec13074ea25d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047410 Jul 12 18:40:00.696125 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 547/1051] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:01.680014 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5e04d179-761c-4b36-ab85-3a67b7801d3f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:01.682263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5e04d179-761c-4b36-ab85-3a67b7801d3f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:01.695338 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e04d179-761c-4b36-ab85-3a67b7801d3f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:01.696129 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e04d179-761c-4b36-ab85-3a67b7801d3f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:01.697666 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e04d179-761c-4b36-ab85-3a67b7801d3f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:01.699038 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e04d179-761c-4b36-ab85-3a67b7801d3f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:01.709954 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-702174af-c548-4c91-984f-52f195737753 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:01.711167 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-702174af-c548-4c91-984f-52f195737753 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:01.721367 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-702174af-c548-4c91-984f-52f195737753 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:01.722026 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-702174af-c548-4c91-984f-52f195737753 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:01.723440 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-702174af-c548-4c91-984f-52f195737753 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:01.724506 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-702174af-c548-4c91-984f-52f195737753 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:01.765834 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-702174af-c548-4c91-984f-52f195737753 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:01.766505 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-702174af-c548-4c91-984f-52f195737753 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:01.767058 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-702174af-c548-4c91-984f-52f195737753 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lazy-loading 'fault' on Instance uuid a5a4ad3d-1558-4562-9b6b-10d350b59196 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:40:01.814770 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-702174af-c548-4c91-984f-52f195737753 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:01.824895 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-702174af-c548-4c91-984f-52f195737753 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 200 len: 1230 microversion: 2.1 time: 0.124467 Jul 12 18:40:01.825644 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 548/1052] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:01 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 1230 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:40:02.330248 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5e04d179-761c-4b36-ab85-3a67b7801d3f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:02.338877 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5e04d179-761c-4b36-ab85-3a67b7801d3f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1272 microversion: 2.1 time: 0.666571 Jul 12 18:40:02.340031 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 505/1053] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:01 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1272 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:02.851227 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e533e9f3-12b1-4876-9887-3ec5b1cc592c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:02.852076 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e533e9f3-12b1-4876-9887-3ec5b1cc592c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: a5a4ad3d-1558-4562-9b6b-10d350b59196] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:02.860715 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e533e9f3-12b1-4876-9887-3ec5b1cc592c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:02.861164 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e533e9f3-12b1-4876-9887-3ec5b1cc592c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:02.861960 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e533e9f3-12b1-4876-9887-3ec5b1cc592c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:02.862432 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e533e9f3-12b1-4876-9887-3ec5b1cc592c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:02.878554 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-e533e9f3-12b1-4876-9887-3ec5b1cc592c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] HTTP exception thrown: Instance a5a4ad3d-1558-4562-9b6b-10d350b59196 could not be found. Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e533e9f3-12b1-4876-9887-3ec5b1cc592c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Request method failure captured: Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 HTTP/1.1 Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb5g-VR3KwwJyH66d8kwPDNjs-m_IjFONcC1Tsci-uR-SKzfdiJPUuh5LNpwN1QTziJ6zpflWI_6Dw-sOicuPFf9e0ORcKKOuc66Jf4YqquAbaVCc19qP8U-BOySfON5Vx17tAuxVqmxwfsr8obauKifbLh_jOdMwOkThPvo4iRxF9I Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 447abd08211d49f9b503130ac5c380b7 Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:40:02.880331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_447abd08211d49f9b503130ac5c380b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 447abd08211d49f9b503130ac5c380b7 Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-TestVolumeBootPattern-2076851829-project Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 7a647aab17cf4345800cd9072a7820c0 Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-TestVolumeBootPattern-2076851829-project Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance a5a4ad3d-1558-4562-9b6b-10d350b59196 could not be found. Jul 12 18:40:02.883414 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': 'a5a4ad3d-1558-4562-9b6b-10d350b59196'} Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a4ad3d-1558-4562-9b6b-10d350b59196 could not be found. Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:40:02.885938 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a4ad3d-1558-4562-9b6b-10d350b59196 could not be found. Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a4ad3d-1558-4562-9b6b-10d350b59196 could not be found. Jul 12 18:40:02.889099 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:40:02.893473 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e533e9f3-12b1-4876-9887-3ec5b1cc592c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Returning 404 to user: Instance a5a4ad3d-1558-4562-9b6b-10d350b59196 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:40:02.893473 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e533e9f3-12b1-4876-9887-3ec5b1cc592c tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196" status: 404 len: 111 microversion: 2.1 time: 0.034770 Jul 12 18:40:02.899493 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 549/1054] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:02 2022] GET /compute/v2.1/servers/a5a4ad3d-1558-4562-9b6b-10d350b59196 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:40:02.917538 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-fd12ec49-0310-4092-a09c-1588ac0ceab4 req-5e9cda07-ad2f-4b21-af80-eff088bf0990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dad77cc-8aa1-405e-92b9-1a0a392b3901", "tag": "cf5bfb83-fffe-4616-9599-9c83ec953b80"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:02.932907 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-fd12ec49-0310-4092-a09c-1588ac0ceab4 req-5e9cda07-ad2f-4b21-af80-eff088bf0990 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:02.933659 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-fd12ec49-0310-4092-a09c-1588ac0ceab4 req-5e9cda07-ad2f-4b21-af80-eff088bf0990 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:02.947528 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-fd12ec49-0310-4092-a09c-1588ac0ceab4 req-5e9cda07-ad2f-4b21-af80-eff088bf0990 service nova] Creating event network-changed:cf5bfb83-fffe-4616-9599-9c83ec953b80 for instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 on hv-cinder-84488 Jul 12 18:40:02.953069 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-fd12ec49-0310-4092-a09c-1588ac0ceab4 req-5e9cda07-ad2f-4b21-af80-eff088bf0990 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054204 Jul 12 18:40:02.959311 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 506/1055] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:03.357896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7792c735-1c76-4d70-924c-9768004fde42 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:03.358512 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7792c735-1c76-4d70-924c-9768004fde42 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:03.364821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7792c735-1c76-4d70-924c-9768004fde42 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:03.365182 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7792c735-1c76-4d70-924c-9768004fde42 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:03.365966 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7792c735-1c76-4d70-924c-9768004fde42 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:03.366462 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7792c735-1c76-4d70-924c-9768004fde42 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:03.525957 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7792c735-1c76-4d70-924c-9768004fde42 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:03.534428 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7792c735-1c76-4d70-924c-9768004fde42 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.180370 Jul 12 18:40:03.535011 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 550/1056] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:03 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:04.553735 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-035494e3-d150-44ad-b40c-8f8d35c5b80f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:04.554385 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-035494e3-d150-44ad-b40c-8f8d35c5b80f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:04.561343 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-035494e3-d150-44ad-b40c-8f8d35c5b80f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:04.561933 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-035494e3-d150-44ad-b40c-8f8d35c5b80f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:04.562762 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-035494e3-d150-44ad-b40c-8f8d35c5b80f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:04.563245 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-035494e3-d150-44ad-b40c-8f8d35c5b80f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:04.716406 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-035494e3-d150-44ad-b40c-8f8d35c5b80f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:04.724688 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-035494e3-d150-44ad-b40c-8f8d35c5b80f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.175637 Jul 12 18:40:04.725279 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 507/1057] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:04 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:40:05.743894 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-a41961fd-5a7a-4ba1-ac6f-72e6ee26c06c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:05.744930 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-a41961fd-5a7a-4ba1-ac6f-72e6ee26c06c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:05.754412 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a41961fd-5a7a-4ba1-ac6f-72e6ee26c06c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:05.755117 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a41961fd-5a7a-4ba1-ac6f-72e6ee26c06c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:05.756046 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a41961fd-5a7a-4ba1-ac6f-72e6ee26c06c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:05.756647 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-a41961fd-5a7a-4ba1-ac6f-72e6ee26c06c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:05.933367 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-a41961fd-5a7a-4ba1-ac6f-72e6ee26c06c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:05.945659 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-a41961fd-5a7a-4ba1-ac6f-72e6ee26c06c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.206217 Jul 12 18:40:05.946670 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 551/1058] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:05 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:06.484170 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-bc38d8cd-e4ba-4029-a0d6-338db16df8b9 req-0815a682-431b-44af-aff1-2c5b0ecda8b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1731378e-059e-427c-98c5-d580418675a8", "tag": "69273601-4b08-4ca9-9e53-e3ba1af0d8dd"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:06.490551 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-22e468cb-e731-43ab-b293-28f81d7ab2ee tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:06.491488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-22e468cb-e731-43ab-b293-28f81d7ab2ee tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:06.495067 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:06.498578 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-bc38d8cd-e4ba-4029-a0d6-338db16df8b9 req-0815a682-431b-44af-aff1-2c5b0ecda8b4 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:06.499517 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-bc38d8cd-e4ba-4029-a0d6-338db16df8b9 req-0815a682-431b-44af-aff1-2c5b0ecda8b4 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:06.504703 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-22e468cb-e731-43ab-b293-28f81d7ab2ee tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:06.505818 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-22e468cb-e731-43ab-b293-28f81d7ab2ee tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:06.507083 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-22e468cb-e731-43ab-b293-28f81d7ab2ee tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:06.507827 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-22e468cb-e731-43ab-b293-28f81d7ab2ee tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:06.521859 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-bc38d8cd-e4ba-4029-a0d6-338db16df8b9 req-0815a682-431b-44af-aff1-2c5b0ecda8b4 service nova] Creating event network-changed:69273601-4b08-4ca9-9e53-e3ba1af0d8dd for instance 1731378e-059e-427c-98c5-d580418675a8 on hv-cinder-84488 Jul 12 18:40:06.531020 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-bc38d8cd-e4ba-4029-a0d6-338db16df8b9 req-0815a682-431b-44af-aff1-2c5b0ecda8b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050346 Jul 12 18:40:06.532416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 552/1059] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:06.559539 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-22e468cb-e731-43ab-b293-28f81d7ab2ee tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:40:06.881265 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-22e468cb-e731-43ab-b293-28f81d7ab2ee tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 204 len: 0 microversion: 2.1 time: 0.406797 Jul 12 18:40:06.882197 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 508/1060] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:40:06 2022] DELETE /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:40:06.893389 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-71c4f4eb-a487-4fb8-8f47-4dc4af52b48a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:06.894797 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-71c4f4eb-a487-4fb8-8f47-4dc4af52b48a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:06.903079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-71c4f4eb-a487-4fb8-8f47-4dc4af52b48a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:06.909288 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-71c4f4eb-a487-4fb8-8f47-4dc4af52b48a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:06.909288 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-71c4f4eb-a487-4fb8-8f47-4dc4af52b48a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:06.909288 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-71c4f4eb-a487-4fb8-8f47-4dc4af52b48a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:06.964911 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7b4af90b-4516-4c35-b5fa-c217c3efa23a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:06.965620 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7b4af90b-4516-4c35-b5fa-c217c3efa23a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:06.973510 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b4af90b-4516-4c35-b5fa-c217c3efa23a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:06.974632 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b4af90b-4516-4c35-b5fa-c217c3efa23a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:06.976247 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b4af90b-4516-4c35-b5fa-c217c3efa23a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:06.977037 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b4af90b-4516-4c35-b5fa-c217c3efa23a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:07.085854 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-71c4f4eb-a487-4fb8-8f47-4dc4af52b48a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:07.097055 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-71c4f4eb-a487-4fb8-8f47-4dc4af52b48a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1578 microversion: 2.1 time: 0.209241 Jul 12 18:40:07.103510 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 553/1061] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:06 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1578 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:07.146436 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7b4af90b-4516-4c35-b5fa-c217c3efa23a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:07.154712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7b4af90b-4516-4c35-b5fa-c217c3efa23a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.195055 Jul 12 18:40:07.155324 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 509/1062] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:06 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:08.115264 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-fcac7035-0bd7-4dc5-b095-8d3bc1ec55c3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:08.116148 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-fcac7035-0bd7-4dc5-b095-8d3bc1ec55c3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:08.118166 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell0:SELECT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:08.124252 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fcac7035-0bd7-4dc5-b095-8d3bc1ec55c3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:08.124854 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fcac7035-0bd7-4dc5-b095-8d3bc1ec55c3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:08.125614 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fcac7035-0bd7-4dc5-b095-8d3bc1ec55c3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:08.126051 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-fcac7035-0bd7-4dc5-b095-8d3bc1ec55c3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:08.176290 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b6696ee5-4636-4f2d-9c3e-f3f22633fb1e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:08.177291 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b6696ee5-4636-4f2d-9c3e-f3f22633fb1e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:08.183011 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=8 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:08.190699 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6696ee5-4636-4f2d-9c3e-f3f22633fb1e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:08.198871 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6696ee5-4636-4f2d-9c3e-f3f22633fb1e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:08.198871 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6696ee5-4636-4f2d-9c3e-f3f22633fb1e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:08.198871 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6696ee5-4636-4f2d-9c3e-f3f22633fb1e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:08.281185 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-fcac7035-0bd7-4dc5-b095-8d3bc1ec55c3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:08.289152 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-fcac7035-0bd7-4dc5-b095-8d3bc1ec55c3 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1578 microversion: 2.1 time: 0.177850 Jul 12 18:40:08.290122 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 554/1063] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:08 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:08.358165 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b6696ee5-4636-4f2d-9c3e-f3f22633fb1e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:08.366616 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b6696ee5-4636-4f2d-9c3e-f3f22633fb1e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.196946 Jul 12 18:40:08.367223 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 510/1064] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:08 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:09.085355 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-20317f12-73a0-4c9a-b766-43411e91d0d9 req-6bc6aed6-7abf-47f6-9b60-46f93dd82da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1731378e-059e-427c-98c5-d580418675a8", "name": "network-vif-deleted", "tag": "69273601-4b08-4ca9-9e53-e3ba1af0d8dd"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:09.098410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-20317f12-73a0-4c9a-b766-43411e91d0d9 req-6bc6aed6-7abf-47f6-9b60-46f93dd82da1 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:09.098410 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-20317f12-73a0-4c9a-b766-43411e91d0d9 req-6bc6aed6-7abf-47f6-9b60-46f93dd82da1 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:09.111635 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-20317f12-73a0-4c9a-b766-43411e91d0d9 req-6bc6aed6-7abf-47f6-9b60-46f93dd82da1 service nova] Creating event network-vif-deleted:69273601-4b08-4ca9-9e53-e3ba1af0d8dd for instance 1731378e-059e-427c-98c5-d580418675a8 on hv-cinder-84488 Jul 12 18:40:09.116732 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-20317f12-73a0-4c9a-b766-43411e91d0d9 req-6bc6aed6-7abf-47f6-9b60-46f93dd82da1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041886 Jul 12 18:40:09.117446 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 555/1065] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:09.307435 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-89541390-217e-4b32-a326-8abd2a2eabce tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:09.308000 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-89541390-217e-4b32-a326-8abd2a2eabce tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:09.315159 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89541390-217e-4b32-a326-8abd2a2eabce tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:09.315609 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89541390-217e-4b32-a326-8abd2a2eabce tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:09.316422 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89541390-217e-4b32-a326-8abd2a2eabce tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:09.316858 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89541390-217e-4b32-a326-8abd2a2eabce tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:09.386203 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-f94ce6d8-3610-447a-b535-5c5bd9623d8f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:09.386913 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-f94ce6d8-3610-447a-b535-5c5bd9623d8f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:09.392466 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-89541390-217e-4b32-a326-8abd2a2eabce tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:09.394688 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f94ce6d8-3610-447a-b535-5c5bd9623d8f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:09.395354 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f94ce6d8-3610-447a-b535-5c5bd9623d8f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:09.396080 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f94ce6d8-3610-447a-b535-5c5bd9623d8f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:09.396823 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-f94ce6d8-3610-447a-b535-5c5bd9623d8f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:09.401229 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-89541390-217e-4b32-a326-8abd2a2eabce tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1226 microversion: 2.1 time: 0.098157 Jul 12 18:40:09.410680 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 511/1066] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:09 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:09.551484 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-f94ce6d8-3610-447a-b535-5c5bd9623d8f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:09.559974 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-f94ce6d8-3610-447a-b535-5c5bd9623d8f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.178817 Jul 12 18:40:09.560524 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 556/1067] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:09 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:40:10.418744 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f5ed4b9a-e3bc-411e-af05-126a07009008 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:10.419357 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f5ed4b9a-e3bc-411e-af05-126a07009008 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:10.425846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5ed4b9a-e3bc-411e-af05-126a07009008 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:10.426287 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5ed4b9a-e3bc-411e-af05-126a07009008 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:10.427045 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5ed4b9a-e3bc-411e-af05-126a07009008 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:10.427477 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5ed4b9a-e3bc-411e-af05-126a07009008 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:10.459738 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5ed4b9a-e3bc-411e-af05-126a07009008 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:10.460184 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5ed4b9a-e3bc-411e-af05-126a07009008 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:10.460663 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-f5ed4b9a-e3bc-411e-af05-126a07009008 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lazy-loading 'fault' on Instance uuid 1731378e-059e-427c-98c5-d580418675a8 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:40:10.506517 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f5ed4b9a-e3bc-411e-af05-126a07009008 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a647aab17cf4345800cd9072a7820c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '447abd08211d49f9b503130ac5c380b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:10.517246 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f5ed4b9a-e3bc-411e-af05-126a07009008 tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 200 len: 1231 microversion: 2.1 time: 0.102699 Jul 12 18:40:10.518111 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 512/1068] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:10 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:10.577689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-01ea2702-1e88-4664-8ab7-7fe74cac3b14 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:10.578310 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-01ea2702-1e88-4664-8ab7-7fe74cac3b14 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:10.584960 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01ea2702-1e88-4664-8ab7-7fe74cac3b14 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:10.585415 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01ea2702-1e88-4664-8ab7-7fe74cac3b14 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:10.587482 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01ea2702-1e88-4664-8ab7-7fe74cac3b14 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:10.587482 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01ea2702-1e88-4664-8ab7-7fe74cac3b14 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:10.860009 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-01ea2702-1e88-4664-8ab7-7fe74cac3b14 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:10.869580 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-01ea2702-1e88-4664-8ab7-7fe74cac3b14 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.295403 Jul 12 18:40:10.870292 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 557/1069] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:10 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:11.537311 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-80755ad7-c37a-4eef-8322-dcda1cc5e42d tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:11.538320 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-80755ad7-c37a-4eef-8322-dcda1cc5e42d tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 1731378e-059e-427c-98c5-d580418675a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:11.548615 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80755ad7-c37a-4eef-8322-dcda1cc5e42d tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:11.549059 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80755ad7-c37a-4eef-8322-dcda1cc5e42d tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:11.549878 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80755ad7-c37a-4eef-8322-dcda1cc5e42d tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:11.550305 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80755ad7-c37a-4eef-8322-dcda1cc5e42d tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:11.565075 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-80755ad7-c37a-4eef-8322-dcda1cc5e42d tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] HTTP exception thrown: Instance 1731378e-059e-427c-98c5-d580418675a8 could not be found. Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-80755ad7-c37a-4eef-8322-dcda1cc5e42d tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Request method failure captured: Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 HTTP/1.1 Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb5g-VR3KwwJyH66d8kwPDNjs-m_IjFONcC1Tsci-uR-SKzfdiJPUuh5LNpwN1QTziJ6zpflWI_6Dw-sOicuPFf9e0ORcKKOuc66Jf4YqquAbaVCc19qP8U-BOySfON5Vx17tAuxVqmxwfsr8obauKifbLh_jOdMwOkThPvo4iRxF9I Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 447abd08211d49f9b503130ac5c380b7 Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:40:11.567942 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_447abd08211d49f9b503130ac5c380b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 447abd08211d49f9b503130ac5c380b7 Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-TestVolumeBootPattern-2076851829-project Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 7a647aab17cf4345800cd9072a7820c0 Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-TestVolumeBootPattern-2076851829-project Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 1731378e-059e-427c-98c5-d580418675a8 could not be found. Jul 12 18:40:11.570614 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '1731378e-059e-427c-98c5-d580418675a8'} Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1731378e-059e-427c-98c5-d580418675a8 could not be found. Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:40:11.572501 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1731378e-059e-427c-98c5-d580418675a8 could not be found. Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1731378e-059e-427c-98c5-d580418675a8 could not be found. Jul 12 18:40:11.574653 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:40:11.577322 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-80755ad7-c37a-4eef-8322-dcda1cc5e42d tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Returning 404 to user: Instance 1731378e-059e-427c-98c5-d580418675a8 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:40:11.577322 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-80755ad7-c37a-4eef-8322-dcda1cc5e42d tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8" status: 404 len: 111 microversion: 2.1 time: 0.036723 Jul 12 18:40:11.577322 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 513/1070] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:11 2022] GET /compute/v2.1/servers/1731378e-059e-427c-98c5-d580418675a8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:40:11.888404 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-01d9d7d7-3e4a-433e-951b-8bcb51e29121 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:11.889284 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-01d9d7d7-3e4a-433e-951b-8bcb51e29121 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:11.896821 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01d9d7d7-3e4a-433e-951b-8bcb51e29121 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:11.897269 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01d9d7d7-3e4a-433e-951b-8bcb51e29121 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:11.898041 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01d9d7d7-3e4a-433e-951b-8bcb51e29121 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:11.898471 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-01d9d7d7-3e4a-433e-951b-8bcb51e29121 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:12.072869 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-01d9d7d7-3e4a-433e-951b-8bcb51e29121 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:12.082785 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-01d9d7d7-3e4a-433e-951b-8bcb51e29121 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.199232 Jul 12 18:40:12.083432 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 558/1071] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:11 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:12.120577 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b163de9f-355d-4b5f-8097-df1e42ac6c9a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:12.121127 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b163de9f-355d-4b5f-8097-df1e42ac6c9a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:12.127908 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b163de9f-355d-4b5f-8097-df1e42ac6c9a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:12.128406 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b163de9f-355d-4b5f-8097-df1e42ac6c9a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:12.129386 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b163de9f-355d-4b5f-8097-df1e42ac6c9a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:12.129812 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b163de9f-355d-4b5f-8097-df1e42ac6c9a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:12.144513 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-b163de9f-355d-4b5f-8097-df1e42ac6c9a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] HTTP exception thrown: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b163de9f-355d-4b5f-8097-df1e42ac6c9a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Request method failure captured: Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 HTTP/1.1 Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb5g-VR3KwwJyH66d8kwPDNjs-m_IjFONcC1Tsci-uR-SKzfdiJPUuh5LNpwN1QTziJ6zpflWI_6Dw-sOicuPFf9e0ORcKKOuc66Jf4YqquAbaVCc19qP8U-BOySfON5Vx17tAuxVqmxwfsr8obauKifbLh_jOdMwOkThPvo4iRxF9I Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: 447abd08211d49f9b503130ac5c380b7 Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:40:12.146068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_447abd08211d49f9b503130ac5c380b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 447abd08211d49f9b503130ac5c380b7 Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-TestVolumeBootPattern-2076851829-project Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 7a647aab17cf4345800cd9072a7820c0 Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-TestVolumeBootPattern-2076851829-project Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:40:12.148712 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2'} Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:40:12.150842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:40:12.153646 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:40:12.156178 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b163de9f-355d-4b5f-8097-df1e42ac6c9a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Returning 404 to user: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:40:12.156178 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b163de9f-355d-4b5f-8097-df1e42ac6c9a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 404 len: 111 microversion: 2.1 time: 0.030948 Jul 12 18:40:12.156178 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 514/1072] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:40:12 2022] DELETE /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:40:12.158409 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2f775472-6a63-4056-ab25-db672514a79a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:12.159019 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-2f775472-6a63-4056-ab25-db672514a79a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] [instance: 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:12.165488 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2f775472-6a63-4056-ab25-db672514a79a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:12.165933 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2f775472-6a63-4056-ab25-db672514a79a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:12.166734 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2f775472-6a63-4056-ab25-db672514a79a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:12.167165 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-2f775472-6a63-4056-ab25-db672514a79a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:12.181815 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.wsgi [None req-2f775472-6a63-4056-ab25-db672514a79a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] HTTP exception thrown: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2f775472-6a63-4056-ab25-db672514a79a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Request method failure captured: Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: request: GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 HTTP/1.1 Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept: application/json Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Accept-Encoding: identity Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Connection: close Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Length: 0 Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Content-Type: application/json Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Host: 10.222.0.47 Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Openstack-System-Scope: None Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: User-Agent: python-urllib3/1.26.9 Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Auth-Token: gAAAAABizb5g-VR3KwwJyH66d8kwPDNjs-m_IjFONcC1Tsci-uR-SKzfdiJPUuh5LNpwN1QTziJ6zpflWI_6Dw-sOicuPFf9e0ORcKKOuc66Jf4YqquAbaVCc19qP8U-BOySfON5Vx17tAuxVqmxwfsr8obauKifbLh_jOdMwOkThPvo4iRxF9I Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Id: None Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Domain-Name: None Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Identity-Status: Confirmed Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Is-Admin-Project: True Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Id: default Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Domain-Name: Default Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Id: 447abd08211d49f9b503130ac5c380b7 Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Project-Name: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Role: member,reader Jul 12 18:40:12.183472 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Roles: member,reader Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_447abd08211d49f9b503130ac5c380b7", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/447abd08211d49f9b503130ac5c380b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Id: 447abd08211d49f9b503130ac5c380b7 Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-Tenant-Name: tempest-TestVolumeBootPattern-2076851829 Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User: tempest-TestVolumeBootPattern-2076851829-project Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Id: default Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Domain-Name: Default Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Id: 7a647aab17cf4345800cd9072a7820c0 Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: X-User-Name: tempest-TestVolumeBootPattern-2076851829-project Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: method: > Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: exception: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:40:12.185995 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: action_args: {'id': '7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2'} Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:40:12.187401 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. Jul 12 18:40:12.189689 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: ERROR nova.api.openstack.wsgi Jul 12 18:40:12.190918 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-2f775472-6a63-4056-ab25-db672514a79a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Returning 404 to user: Instance 7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 could not be found. {{(pid=118411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:40:12.190918 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-2f775472-6a63-4056-ab25-db672514a79a tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2" status: 404 len: 111 microversion: 2.1 time: 0.030372 Jul 12 18:40:12.190918 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 559/1073] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:12 2022] GET /compute/v2.1/servers/7cc3f9e8-6c5c-4cee-ab33-b8db3424c6a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 18:40:13.104689 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2bf2a7d5-a32d-4f36-b99c-fa929ddb6320 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:13.105762 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2bf2a7d5-a32d-4f36-b99c-fa929ddb6320 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:13.117324 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2bf2a7d5-a32d-4f36-b99c-fa929ddb6320 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:13.118624 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2bf2a7d5-a32d-4f36-b99c-fa929ddb6320 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:13.120008 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2bf2a7d5-a32d-4f36-b99c-fa929ddb6320 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:13.120796 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2bf2a7d5-a32d-4f36-b99c-fa929ddb6320 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:13.286938 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2bf2a7d5-a32d-4f36-b99c-fa929ddb6320 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:13.297026 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2bf2a7d5-a32d-4f36-b99c-fa929ddb6320 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.199213 Jul 12 18:40:13.297623 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 515/1074] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:13 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:13.689164 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4ae6822e-72cb-499d-809b-5f03f8fee1ec tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] Calling method '.version_select at 0x7f1bb0a1f8b0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:13.795010 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4ae6822e-72cb-499d-809b-5f03f8fee1ec tempest-TestVolumeBootPattern-2076851829 tempest-TestVolumeBootPattern-2076851829-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1121766819" status: 202 len: 0 microversion: 2.1 time: 0.111545 Jul 12 18:40:13.795591 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 560/1075] 10.222.0.47 () {58 vars in 1262 bytes} [Tue Jul 12 18:40:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1121766819 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:40:14.316982 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0e7e8837-8809-4490-9ee9-dd28bc639035 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:14.318098 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0e7e8837-8809-4490-9ee9-dd28bc639035 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:14.327658 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0e7e8837-8809-4490-9ee9-dd28bc639035 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:14.328330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0e7e8837-8809-4490-9ee9-dd28bc639035 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:14.329224 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0e7e8837-8809-4490-9ee9-dd28bc639035 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:14.329721 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0e7e8837-8809-4490-9ee9-dd28bc639035 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:14.627532 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0e7e8837-8809-4490-9ee9-dd28bc639035 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:14.636780 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0e7e8837-8809-4490-9ee9-dd28bc639035 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.326160 Jul 12 18:40:14.637567 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 516/1076] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:14 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:15.590023 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-01bc6cb3-0c83-4fe7-9b07-bef61d988833 req-e59ea359-d20e-4b2e-b2e9-e79ea213c2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dad77cc-8aa1-405e-92b9-1a0a392b3901", "name": "network-vif-plugged", "status": "completed", "tag": "cf5bfb83-fffe-4616-9599-9c83ec953b80"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:15.603882 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-01bc6cb3-0c83-4fe7-9b07-bef61d988833 req-e59ea359-d20e-4b2e-b2e9-e79ea213c2b9 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:15.604386 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-01bc6cb3-0c83-4fe7-9b07-bef61d988833 req-e59ea359-d20e-4b2e-b2e9-e79ea213c2b9 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:15.616232 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-01bc6cb3-0c83-4fe7-9b07-bef61d988833 req-e59ea359-d20e-4b2e-b2e9-e79ea213c2b9 service nova] Creating event network-vif-plugged:cf5bfb83-fffe-4616-9599-9c83ec953b80 for instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 on hv-cinder-84488 Jul 12 18:40:15.622183 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-01bc6cb3-0c83-4fe7-9b07-bef61d988833 req-e59ea359-d20e-4b2e-b2e9-e79ea213c2b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038943 Jul 12 18:40:15.622805 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 561/1077] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:15.654760 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ef036c8c-b714-468a-af97-3c0710ff53b2 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:15.655378 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ef036c8c-b714-468a-af97-3c0710ff53b2 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:15.662731 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ef036c8c-b714-468a-af97-3c0710ff53b2 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:15.663178 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ef036c8c-b714-468a-af97-3c0710ff53b2 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:15.663958 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ef036c8c-b714-468a-af97-3c0710ff53b2 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:15.664425 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ef036c8c-b714-468a-af97-3c0710ff53b2 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:16.082280 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ef036c8c-b714-468a-af97-3c0710ff53b2 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:16.086088 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:16.091477 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ef036c8c-b714-468a-af97-3c0710ff53b2 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.440697 Jul 12 18:40:16.092067 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 517/1078] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:15 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:40:17.109816 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-07afdfb4-3d12-404b-9f8c-a023cf06e018 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:17.116961 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-07afdfb4-3d12-404b-9f8c-a023cf06e018 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:17.120009 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-07afdfb4-3d12-404b-9f8c-a023cf06e018 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:17.120639 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-07afdfb4-3d12-404b-9f8c-a023cf06e018 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:17.121634 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-07afdfb4-3d12-404b-9f8c-a023cf06e018 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:17.123845 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-07afdfb4-3d12-404b-9f8c-a023cf06e018 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:17.160645 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:17.395331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-07afdfb4-3d12-404b-9f8c-a023cf06e018 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:17.407495 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-07afdfb4-3d12-404b-9f8c-a023cf06e018 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1260 microversion: 2.1 time: 0.301875 Jul 12 18:40:17.411036 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 562/1079] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:17 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1260 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:40:18.432606 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-414b2cdc-118c-4cbe-84a5-d659e1e83125 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:18.433764 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-414b2cdc-118c-4cbe-84a5-d659e1e83125 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:18.444203 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-414b2cdc-118c-4cbe-84a5-d659e1e83125 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:18.448460 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-414b2cdc-118c-4cbe-84a5-d659e1e83125 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:18.451169 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-414b2cdc-118c-4cbe-84a5-d659e1e83125 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:18.451488 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-414b2cdc-118c-4cbe-84a5-d659e1e83125 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:18.691415 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-414b2cdc-118c-4cbe-84a5-d659e1e83125 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:18.699841 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-414b2cdc-118c-4cbe-84a5-d659e1e83125 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1444 microversion: 2.1 time: 0.272446 Jul 12 18:40:18.702370 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 518/1080] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:18 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1444 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:18.717041 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-0c89405a-ed8b-42ee-832f-20f5e8c99b35 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:18.717772 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-0c89405a-ed8b-42ee-832f-20f5e8c99b35 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:40:18.724473 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0c89405a-ed8b-42ee-832f-20f5e8c99b35 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:18.726211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0c89405a-ed8b-42ee-832f-20f5e8c99b35 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:18.726211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0c89405a-ed8b-42ee-832f-20f5e8c99b35 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:18.726211 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-0c89405a-ed8b-42ee-832f-20f5e8c99b35 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:19.286105 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-0c89405a-ed8b-42ee-832f-20f5e8c99b35 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:40:19.295612 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-0c89405a-ed8b-42ee-832f-20f5e8c99b35 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1444 microversion: 2.1 time: 0.582355 Jul 12 18:40:19.296508 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 563/1081] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:40:18 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1444 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:22.884486 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-315f128c-534b-46ed-9a4e-9109e48e6364 req-5c71700c-acc5-4f23-b28f-fa1d7900427b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dad77cc-8aa1-405e-92b9-1a0a392b3901", "tag": "cf5bfb83-fffe-4616-9599-9c83ec953b80"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:22.893461 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-315f128c-534b-46ed-9a4e-9109e48e6364 req-5c71700c-acc5-4f23-b28f-fa1d7900427b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:40:22.893904 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-315f128c-534b-46ed-9a4e-9109e48e6364 req-5c71700c-acc5-4f23-b28f-fa1d7900427b service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:40:22.913936 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-315f128c-534b-46ed-9a4e-9109e48e6364 req-5c71700c-acc5-4f23-b28f-fa1d7900427b service nova] Creating event network-changed:cf5bfb83-fffe-4616-9599-9c83ec953b80 for instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 on hv-cinder-84488 Jul 12 18:40:22.930556 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-315f128c-534b-46ed-9a4e-9109e48e6364 req-5c71700c-acc5-4f23-b28f-fa1d7900427b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045666 Jul 12 18:40:22.931854 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 519/1082] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:41:38.682893 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:41:38.683631 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Tue Jul 12 18:41:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:41:59.371098 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:41:59.371710 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Tue Jul 12 18:41:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:42:11.652122 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:11.652932 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=8 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:11.657181 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-903a14b5-d6f2-4680-b862-735f1854f6a3 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:42:11.657867 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-903a14b5-d6f2-4680-b862-735f1854f6a3 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:11.665003 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-903a14b5-d6f2-4680-b862-735f1854f6a3 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:11.665444 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-903a14b5-d6f2-4680-b862-735f1854f6a3 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:11.666228 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-903a14b5-d6f2-4680-b862-735f1854f6a3 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:11.666637 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-903a14b5-d6f2-4680-b862-735f1854f6a3 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:11.690679 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-903a14b5-d6f2-4680-b862-735f1854f6a3 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lazy-loading 'flavor' on Instance uuid 2dad77cc-8aa1-405e-92b9-1a0a392b3901 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:42:12.201691 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-903a14b5-d6f2-4680-b862-735f1854f6a3 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "POST /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901/action" status: 202 len: 0 microversion: 2.1 time: 0.551277 Jul 12 18:42:12.202283 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 564/1083] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:42:11 2022] POST /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:42:12.209278 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5e95cca9-e130-420d-826c-9a20a8c2487c] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 12 18:42:12.218870 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:12.218870 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=8 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:12.218870 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-39cf7751-d74b-49fd-9772-7d56d3a7ce2f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:12.218870 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-39cf7751-d74b-49fd-9772-7d56d3a7ce2f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:12.223608 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-39cf7751-d74b-49fd-9772-7d56d3a7ce2f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:12.224056 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-39cf7751-d74b-49fd-9772-7d56d3a7ce2f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:12.224857 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-39cf7751-d74b-49fd-9772-7d56d3a7ce2f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:12.225907 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-39cf7751-d74b-49fd-9772-7d56d3a7ce2f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:12.367777 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-39cf7751-d74b-49fd-9772-7d56d3a7ce2f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:12.375916 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-39cf7751-d74b-49fd-9772-7d56d3a7ce2f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.168759 Jul 12 18:42:12.376573 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 520/1084] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:12 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:13.394563 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-4391a049-7a01-4bb4-bd28-b3ce65b4ea75 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:13.395259 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-4391a049-7a01-4bb4-bd28-b3ce65b4ea75 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:13.402106 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4391a049-7a01-4bb4-bd28-b3ce65b4ea75 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:13.402551 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4391a049-7a01-4bb4-bd28-b3ce65b4ea75 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:13.403369 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4391a049-7a01-4bb4-bd28-b3ce65b4ea75 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:13.403873 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-4391a049-7a01-4bb4-bd28-b3ce65b4ea75 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:13.540056 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-4391a049-7a01-4bb4-bd28-b3ce65b4ea75 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:13.547856 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-4391a049-7a01-4bb4-bd28-b3ce65b4ea75 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.158146 Jul 12 18:42:13.548431 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 565/1085] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:13 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:14.565773 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c32ceac5-48a1-42d3-bbd4-ed22903b1e49 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:14.566417 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c32ceac5-48a1-42d3-bbd4-ed22903b1e49 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:14.576251 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c32ceac5-48a1-42d3-bbd4-ed22903b1e49 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:14.576727 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c32ceac5-48a1-42d3-bbd4-ed22903b1e49 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:14.577498 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c32ceac5-48a1-42d3-bbd4-ed22903b1e49 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:14.577924 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c32ceac5-48a1-42d3-bbd4-ed22903b1e49 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:14.583330 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] [5e95cca9-e130-420d-826c-9a20a8c2487c] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 59464. Jul 12 18:42:14.712043 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c32ceac5-48a1-42d3-bbd4-ed22903b1e49 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:14.719824 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c32ceac5-48a1-42d3-bbd4-ed22903b1e49 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.157960 Jul 12 18:42:14.720420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 521/1086] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:14 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:15.737712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-633d7646-3215-47f2-a0f8-27b8828bdcc7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:15.738278 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-633d7646-3215-47f2-a0f8-27b8828bdcc7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:15.745006 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-633d7646-3215-47f2-a0f8-27b8828bdcc7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:15.745449 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-633d7646-3215-47f2-a0f8-27b8828bdcc7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:15.746206 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-633d7646-3215-47f2-a0f8-27b8828bdcc7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:15.746641 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-633d7646-3215-47f2-a0f8-27b8828bdcc7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:15.882577 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-633d7646-3215-47f2-a0f8-27b8828bdcc7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:15.890002 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-633d7646-3215-47f2-a0f8-27b8828bdcc7 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.156301 Jul 12 18:42:15.890562 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 566/1087] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:15 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:16.907655 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c6d230af-117a-4580-9ceb-be3659f759de tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:16.908262 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c6d230af-117a-4580-9ceb-be3659f759de tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:16.915128 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6d230af-117a-4580-9ceb-be3659f759de tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:16.918068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6d230af-117a-4580-9ceb-be3659f759de tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:16.918068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6d230af-117a-4580-9ceb-be3659f759de tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:16.918068 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6d230af-117a-4580-9ceb-be3659f759de tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:17.060526 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c6d230af-117a-4580-9ceb-be3659f759de tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:17.064168 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c6d230af-117a-4580-9ceb-be3659f759de tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.160519 Jul 12 18:42:17.064750 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 522/1088] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:16 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:18.080999 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-5d559266-41ce-441d-8b3d-544bbe96e3ca tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:18.081636 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-5d559266-41ce-441d-8b3d-544bbe96e3ca tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:18.088700 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d559266-41ce-441d-8b3d-544bbe96e3ca tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:18.089150 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d559266-41ce-441d-8b3d-544bbe96e3ca tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:18.089958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d559266-41ce-441d-8b3d-544bbe96e3ca tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:18.090398 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-5d559266-41ce-441d-8b3d-544bbe96e3ca tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:18.227528 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-5d559266-41ce-441d-8b3d-544bbe96e3ca tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:18.235205 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-5d559266-41ce-441d-8b3d-544bbe96e3ca tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.158192 Jul 12 18:42:18.235778 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 567/1089] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:18 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:19.253168 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a3cf74e7-661b-4ef5-9c58-85e2757cc6ff tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:19.253760 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a3cf74e7-661b-4ef5-9c58-85e2757cc6ff tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:19.260398 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a3cf74e7-661b-4ef5-9c58-85e2757cc6ff tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:19.260837 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a3cf74e7-661b-4ef5-9c58-85e2757cc6ff tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:19.261594 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a3cf74e7-661b-4ef5-9c58-85e2757cc6ff tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:19.262017 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a3cf74e7-661b-4ef5-9c58-85e2757cc6ff tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:19.392679 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a3cf74e7-661b-4ef5-9c58-85e2757cc6ff tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:19.400711 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a3cf74e7-661b-4ef5-9c58-85e2757cc6ff tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.151576 Jul 12 18:42:19.401279 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 523/1090] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:19 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:20.418665 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6d295d88-c1b1-4337-b82c-0f2cca1ea8cb tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:20.419277 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6d295d88-c1b1-4337-b82c-0f2cca1ea8cb tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:20.426186 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6d295d88-c1b1-4337-b82c-0f2cca1ea8cb tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:20.426637 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6d295d88-c1b1-4337-b82c-0f2cca1ea8cb tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:20.427408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6d295d88-c1b1-4337-b82c-0f2cca1ea8cb tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:20.427842 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6d295d88-c1b1-4337-b82c-0f2cca1ea8cb tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:20.567416 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-6d295d88-c1b1-4337-b82c-0f2cca1ea8cb tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:20.575576 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6d295d88-c1b1-4337-b82c-0f2cca1ea8cb tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.160864 Jul 12 18:42:20.576148 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 568/1091] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:20 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:21.593782 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-416a2dc5-b7d6-4001-95db-509389a1925f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:21.594421 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-416a2dc5-b7d6-4001-95db-509389a1925f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:21.601846 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-416a2dc5-b7d6-4001-95db-509389a1925f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:21.602287 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-416a2dc5-b7d6-4001-95db-509389a1925f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:21.603046 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-416a2dc5-b7d6-4001-95db-509389a1925f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:21.603473 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-416a2dc5-b7d6-4001-95db-509389a1925f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:21.742466 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-416a2dc5-b7d6-4001-95db-509389a1925f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:21.751104 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-416a2dc5-b7d6-4001-95db-509389a1925f tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.161105 Jul 12 18:42:21.751670 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 524/1092] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:21 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:22.768601 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e8324dfe-17d8-418a-bc0d-52f161eb7219 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:22.769222 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e8324dfe-17d8-418a-bc0d-52f161eb7219 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:22.776839 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e8324dfe-17d8-418a-bc0d-52f161eb7219 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:22.777280 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e8324dfe-17d8-418a-bc0d-52f161eb7219 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:22.778011 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e8324dfe-17d8-418a-bc0d-52f161eb7219 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:22.778443 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e8324dfe-17d8-418a-bc0d-52f161eb7219 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:22.933743 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e8324dfe-17d8-418a-bc0d-52f161eb7219 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:22.942670 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e8324dfe-17d8-418a-bc0d-52f161eb7219 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.177617 Jul 12 18:42:22.942670 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 569/1093] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:22 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:23.960566 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1a4f20c7-ea61-4a60-b207-59daddd273a0 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:23.961179 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1a4f20c7-ea61-4a60-b207-59daddd273a0 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:23.968098 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a4f20c7-ea61-4a60-b207-59daddd273a0 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:23.968572 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a4f20c7-ea61-4a60-b207-59daddd273a0 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:23.969346 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a4f20c7-ea61-4a60-b207-59daddd273a0 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:23.969775 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a4f20c7-ea61-4a60-b207-59daddd273a0 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:24.109542 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1a4f20c7-ea61-4a60-b207-59daddd273a0 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:24.117270 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1a4f20c7-ea61-4a60-b207-59daddd273a0 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.161160 Jul 12 18:42:24.117842 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 525/1094] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:23 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:25.135393 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c662ba05-8972-45e4-89fb-3b61d5e30a0e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:25.136038 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c662ba05-8972-45e4-89fb-3b61d5e30a0e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:25.143431 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c662ba05-8972-45e4-89fb-3b61d5e30a0e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:25.143880 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c662ba05-8972-45e4-89fb-3b61d5e30a0e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:25.144679 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c662ba05-8972-45e4-89fb-3b61d5e30a0e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:25.145111 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c662ba05-8972-45e4-89fb-3b61d5e30a0e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:25.289620 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c662ba05-8972-45e4-89fb-3b61d5e30a0e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:25.299812 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c662ba05-8972-45e4-89fb-3b61d5e30a0e tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.168892 Jul 12 18:42:25.300533 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 570/1095] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:25 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:26.326578 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bb8121e4-72c1-4346-b618-af9369071f92 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:26.327379 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bb8121e4-72c1-4346-b618-af9369071f92 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:26.335505 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb8121e4-72c1-4346-b618-af9369071f92 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:26.337979 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb8121e4-72c1-4346-b618-af9369071f92 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:26.337979 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb8121e4-72c1-4346-b618-af9369071f92 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:26.337979 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb8121e4-72c1-4346-b618-af9369071f92 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:26.505528 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb8121e4-72c1-4346-b618-af9369071f92 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:26.514967 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bb8121e4-72c1-4346-b618-af9369071f92 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1570 microversion: 2.1 time: 0.192551 Jul 12 18:42:26.515560 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 526/1096] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:26 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1570 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:26.538767 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-6a72b54e-71c2-48d2-a1c6-829cfae4b1d6 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:42:26.539412 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-6a72b54e-71c2-48d2-a1c6-829cfae4b1d6 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:26.546582 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6a72b54e-71c2-48d2-a1c6-829cfae4b1d6 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:26.551281 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6a72b54e-71c2-48d2-a1c6-829cfae4b1d6 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:26.551281 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6a72b54e-71c2-48d2-a1c6-829cfae4b1d6 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:26.551281 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-6a72b54e-71c2-48d2-a1c6-829cfae4b1d6 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:26.811337 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-6a72b54e-71c2-48d2-a1c6-829cfae4b1d6 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "POST /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901/action" status: 202 len: 0 microversion: 2.1 time: 0.277174 Jul 12 18:42:26.811983 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 571/1097] 10.222.0.47 () {60 vars in 1277 bytes} [Tue Jul 12 18:42:26 2022] POST /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:42:26.822620 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5bd06cce-1eda-4d82-be95-25027a88e3bf tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:26.823238 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5bd06cce-1eda-4d82-be95-25027a88e3bf tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:26.832243 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5bd06cce-1eda-4d82-be95-25027a88e3bf tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:26.832726 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5bd06cce-1eda-4d82-be95-25027a88e3bf tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:26.833574 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5bd06cce-1eda-4d82-be95-25027a88e3bf tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:26.834016 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5bd06cce-1eda-4d82-be95-25027a88e3bf tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:27.007994 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5bd06cce-1eda-4d82-be95-25027a88e3bf tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:27.015899 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5bd06cce-1eda-4d82-be95-25027a88e3bf tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1518 microversion: 2.1 time: 0.198177 Jul 12 18:42:27.016522 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 527/1098] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:26 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:28.034570 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-1696a6ed-22f6-4ba7-af97-a703969af72d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:28.035195 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-1696a6ed-22f6-4ba7-af97-a703969af72d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:28.041966 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1696a6ed-22f6-4ba7-af97-a703969af72d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:28.042423 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1696a6ed-22f6-4ba7-af97-a703969af72d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:28.043210 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1696a6ed-22f6-4ba7-af97-a703969af72d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:28.043652 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-1696a6ed-22f6-4ba7-af97-a703969af72d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:28.187086 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-1696a6ed-22f6-4ba7-af97-a703969af72d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:28.194736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-1696a6ed-22f6-4ba7-af97-a703969af72d tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1520 microversion: 2.1 time: 0.164560 Jul 12 18:42:28.195300 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 572/1099] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:28 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:28.306908 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-4b1c578e-3cd7-4f2b-a6a5-81af13451624 req-2b7013b3-b304-4e47-9e53-43e9d8343cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dad77cc-8aa1-405e-92b9-1a0a392b3901", "name": "network-vif-unplugged", "status": "completed", "tag": "cf5bfb83-fffe-4616-9599-9c83ec953b80"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:42:28.315159 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-4b1c578e-3cd7-4f2b-a6a5-81af13451624 req-2b7013b3-b304-4e47-9e53-43e9d8343cc0 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:28.315600 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-4b1c578e-3cd7-4f2b-a6a5-81af13451624 req-2b7013b3-b304-4e47-9e53-43e9d8343cc0 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:28.329215 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.compute.server_external_events [req-4b1c578e-3cd7-4f2b-a6a5-81af13451624 req-2b7013b3-b304-4e47-9e53-43e9d8343cc0 service nova] Unable to find a host for instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901. Dropping event network-vif-unplugged {{(pid=118410) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 18:42:28.329215 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-4b1c578e-3cd7-4f2b-a6a5-81af13451624 req-2b7013b3-b304-4e47-9e53-43e9d8343cc0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086155 Jul 12 18:42:28.329529 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 528/1100] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 18:42:29.212245 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-e58d887f-360f-4d7e-8c1a-09f8ba851e72 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:29.212896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-e58d887f-360f-4d7e-8c1a-09f8ba851e72 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:29.219572 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e58d887f-360f-4d7e-8c1a-09f8ba851e72 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:29.220007 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e58d887f-360f-4d7e-8c1a-09f8ba851e72 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:29.220843 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e58d887f-360f-4d7e-8c1a-09f8ba851e72 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:29.221280 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-e58d887f-360f-4d7e-8c1a-09f8ba851e72 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:29.365142 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-e58d887f-360f-4d7e-8c1a-09f8ba851e72 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:29.372958 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-e58d887f-360f-4d7e-8c1a-09f8ba851e72 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1520 microversion: 2.1 time: 0.165043 Jul 12 18:42:29.373528 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 573/1101] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:29 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:30.390442 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ac7f8860-e7c8-43d6-8859-7f8e2b0c02c1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:30.391035 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ac7f8860-e7c8-43d6-8859-7f8e2b0c02c1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:30.397867 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac7f8860-e7c8-43d6-8859-7f8e2b0c02c1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:30.398307 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac7f8860-e7c8-43d6-8859-7f8e2b0c02c1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:30.399079 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac7f8860-e7c8-43d6-8859-7f8e2b0c02c1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:30.399510 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac7f8860-e7c8-43d6-8859-7f8e2b0c02c1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:30.565057 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ac7f8860-e7c8-43d6-8859-7f8e2b0c02c1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:30.573277 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ac7f8860-e7c8-43d6-8859-7f8e2b0c02c1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1576 microversion: 2.1 time: 0.186599 Jul 12 18:42:30.573891 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 529/1102] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:30 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:31.590824 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-61d3a7f5-0ffc-4f3f-8bfb-10d8828be0f4 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:31.591426 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-61d3a7f5-0ffc-4f3f-8bfb-10d8828be0f4 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:31.598017 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-61d3a7f5-0ffc-4f3f-8bfb-10d8828be0f4 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:31.598465 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-61d3a7f5-0ffc-4f3f-8bfb-10d8828be0f4 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:31.599226 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-61d3a7f5-0ffc-4f3f-8bfb-10d8828be0f4 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:31.600020 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-61d3a7f5-0ffc-4f3f-8bfb-10d8828be0f4 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:31.736076 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-61d3a7f5-0ffc-4f3f-8bfb-10d8828be0f4 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:31.745737 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-61d3a7f5-0ffc-4f3f-8bfb-10d8828be0f4 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1576 microversion: 2.1 time: 0.158885 Jul 12 18:42:31.746331 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 574/1103] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:31 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:32.763576 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b3897345-1451-41e6-8b4f-b8b63e38e65a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:32.764391 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b3897345-1451-41e6-8b4f-b8b63e38e65a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:32.770917 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b3897345-1451-41e6-8b4f-b8b63e38e65a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:32.771349 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b3897345-1451-41e6-8b4f-b8b63e38e65a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:32.772755 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b3897345-1451-41e6-8b4f-b8b63e38e65a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:32.773222 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b3897345-1451-41e6-8b4f-b8b63e38e65a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:32.910054 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b3897345-1451-41e6-8b4f-b8b63e38e65a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:32.917789 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b3897345-1451-41e6-8b4f-b8b63e38e65a tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1576 microversion: 2.1 time: 0.158168 Jul 12 18:42:32.918358 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 530/1104] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:32 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:33.935228 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-98cb0ed2-2ca7-415b-8d1e-47c958090263 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:33.935837 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-98cb0ed2-2ca7-415b-8d1e-47c958090263 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:33.942917 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-98cb0ed2-2ca7-415b-8d1e-47c958090263 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:33.943940 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-98cb0ed2-2ca7-415b-8d1e-47c958090263 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:33.944828 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-98cb0ed2-2ca7-415b-8d1e-47c958090263 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:33.945265 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-98cb0ed2-2ca7-415b-8d1e-47c958090263 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:34.083588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-98cb0ed2-2ca7-415b-8d1e-47c958090263 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:34.091662 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-98cb0ed2-2ca7-415b-8d1e-47c958090263 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1576 microversion: 2.1 time: 0.160484 Jul 12 18:42:34.092219 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 575/1105] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:33 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:35.108889 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6623f29b-efec-41a9-a0d6-5976a1fc35d9 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:35.109460 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6623f29b-efec-41a9-a0d6-5976a1fc35d9 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:35.116671 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6623f29b-efec-41a9-a0d6-5976a1fc35d9 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:35.117113 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6623f29b-efec-41a9-a0d6-5976a1fc35d9 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:35.117876 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6623f29b-efec-41a9-a0d6-5976a1fc35d9 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:35.118302 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6623f29b-efec-41a9-a0d6-5976a1fc35d9 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:35.250398 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6623f29b-efec-41a9-a0d6-5976a1fc35d9 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:35.258247 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6623f29b-efec-41a9-a0d6-5976a1fc35d9 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1576 microversion: 2.1 time: 0.153393 Jul 12 18:42:35.258802 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 531/1106] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:35 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:36.275897 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-afdf6999-4f37-4f59-b9f2-153a4143a56c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:36.276546 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-afdf6999-4f37-4f59-b9f2-153a4143a56c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:36.283188 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afdf6999-4f37-4f59-b9f2-153a4143a56c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:36.283637 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afdf6999-4f37-4f59-b9f2-153a4143a56c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:36.284445 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afdf6999-4f37-4f59-b9f2-153a4143a56c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:36.284885 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-afdf6999-4f37-4f59-b9f2-153a4143a56c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:36.419153 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-afdf6999-4f37-4f59-b9f2-153a4143a56c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:36.426565 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-afdf6999-4f37-4f59-b9f2-153a4143a56c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1576 microversion: 2.1 time: 0.155361 Jul 12 18:42:36.427114 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 576/1107] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:36 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:37.442998 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e786a9e6-6e2c-4131-a405-bc1bc5200435 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:37.444345 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e786a9e6-6e2c-4131-a405-bc1bc5200435 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:37.450647 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e786a9e6-6e2c-4131-a405-bc1bc5200435 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:37.450980 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e786a9e6-6e2c-4131-a405-bc1bc5200435 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:37.451755 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e786a9e6-6e2c-4131-a405-bc1bc5200435 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:37.452186 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e786a9e6-6e2c-4131-a405-bc1bc5200435 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:37.593994 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e786a9e6-6e2c-4131-a405-bc1bc5200435 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:37.602365 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e786a9e6-6e2c-4131-a405-bc1bc5200435 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1576 microversion: 2.1 time: 0.163240 Jul 12 18:42:37.602950 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 532/1108] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:37 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:38.619486 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-7d02aa87-06bb-4d74-95c4-92b67d3fab59 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:38.620957 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-7d02aa87-06bb-4d74-95c4-92b67d3fab59 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:38.628588 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7d02aa87-06bb-4d74-95c4-92b67d3fab59 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:38.629040 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7d02aa87-06bb-4d74-95c4-92b67d3fab59 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:38.629827 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7d02aa87-06bb-4d74-95c4-92b67d3fab59 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:38.630266 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-7d02aa87-06bb-4d74-95c4-92b67d3fab59 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:38.650841 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:38.776736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-7d02aa87-06bb-4d74-95c4-92b67d3fab59 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:38.783974 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-7d02aa87-06bb-4d74-95c4-92b67d3fab59 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1576 microversion: 2.1 time: 0.168344 Jul 12 18:42:38.784591 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 577/1109] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:38 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:39.802344 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e2d9c3b5-680d-4f4a-934b-063ad772bd7b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:39.803579 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e2d9c3b5-680d-4f4a-934b-063ad772bd7b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:39.809960 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e2d9c3b5-680d-4f4a-934b-063ad772bd7b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:39.810405 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e2d9c3b5-680d-4f4a-934b-063ad772bd7b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:39.811169 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e2d9c3b5-680d-4f4a-934b-063ad772bd7b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:39.811601 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e2d9c3b5-680d-4f4a-934b-063ad772bd7b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:39.944758 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e2d9c3b5-680d-4f4a-934b-063ad772bd7b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:39.952873 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e2d9c3b5-680d-4f4a-934b-063ad772bd7b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1576 microversion: 2.1 time: 0.154457 Jul 12 18:42:39.953460 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 533/1110] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:39 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:40.369952 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-fb347ab8-0979-4ff2-9d55-4f0ad4ec8172 req-cf6d4256-f17c-4375-a121-9e503c4b2701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dad77cc-8aa1-405e-92b9-1a0a392b3901", "name": "network-vif-plugged", "status": "completed", "tag": "cf5bfb83-fffe-4616-9599-9c83ec953b80"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:42:40.379415 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-fb347ab8-0979-4ff2-9d55-4f0ad4ec8172 req-cf6d4256-f17c-4375-a121-9e503c4b2701 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:40.379872 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-fb347ab8-0979-4ff2-9d55-4f0ad4ec8172 req-cf6d4256-f17c-4375-a121-9e503c4b2701 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:40.391987 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-fb347ab8-0979-4ff2-9d55-4f0ad4ec8172 req-cf6d4256-f17c-4375-a121-9e503c4b2701 service nova] Creating event network-vif-plugged:cf5bfb83-fffe-4616-9599-9c83ec953b80 for instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 on hv-cinder-84488 Jul 12 18:42:40.397640 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-fb347ab8-0979-4ff2-9d55-4f0ad4ec8172 req-cf6d4256-f17c-4375-a121-9e503c4b2701 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031791 Jul 12 18:42:40.398233 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 578/1111] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:42:40.971246 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-85549886-1c69-4364-999f-af5f31a3f661 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:40.971800 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-85549886-1c69-4364-999f-af5f31a3f661 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:40.978601 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-85549886-1c69-4364-999f-af5f31a3f661 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:40.979061 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-85549886-1c69-4364-999f-af5f31a3f661 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:40.979830 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-85549886-1c69-4364-999f-af5f31a3f661 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:40.980267 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-85549886-1c69-4364-999f-af5f31a3f661 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:41.121353 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-85549886-1c69-4364-999f-af5f31a3f661 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:41.129157 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-85549886-1c69-4364-999f-af5f31a3f661 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1576 microversion: 2.1 time: 0.162014 Jul 12 18:42:41.129719 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 534/1112] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:40 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:42.148268 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-49dabf98-7068-4d16-a8d8-1a2a18c1604b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:42.149084 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-49dabf98-7068-4d16-a8d8-1a2a18c1604b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:42:42.151013 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=33 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:42.156075 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-49dabf98-7068-4d16-a8d8-1a2a18c1604b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:42.156559 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-49dabf98-7068-4d16-a8d8-1a2a18c1604b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:42.157322 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-49dabf98-7068-4d16-a8d8-1a2a18c1604b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:42:42.157755 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-49dabf98-7068-4d16-a8d8-1a2a18c1604b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:42:42.290222 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-49dabf98-7068-4d16-a8d8-1a2a18c1604b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:42:42.298047 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-49dabf98-7068-4d16-a8d8-1a2a18c1604b tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1563 microversion: 2.1 time: 0.155104 Jul 12 18:42:42.298614 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 579/1113] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:42:42 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:43:59.286565 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=30 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:59.287481 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=86 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:59.289330 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_api:SELECT=1 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:59.290158 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG dbcounter [-] [118411] Writing DB stats nova_cell1:SELECT=10 {{(pid=118411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:43:59.292800 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-130dec07-560b-4f7f-ae2d-35103e962137 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:43:59.293563 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-130dec07-560b-4f7f-ae2d-35103e962137 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:43:59.300062 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-130dec07-560b-4f7f-ae2d-35103e962137 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:43:59.300898 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-130dec07-560b-4f7f-ae2d-35103e962137 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:43:59.306702 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-130dec07-560b-4f7f-ae2d-35103e962137 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:43:59.306702 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-130dec07-560b-4f7f-ae2d-35103e962137 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:43:59.330890 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-130dec07-560b-4f7f-ae2d-35103e962137 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:43:59.463672 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-84b3537c-1de2-4306-aa41-21bd296bf55c req-18bd71c4-98d9-423c-8590-ff7844b8a906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dad77cc-8aa1-405e-92b9-1a0a392b3901", "tag": "cf5bfb83-fffe-4616-9599-9c83ec953b80"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:43:59.472409 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-84b3537c-1de2-4306-aa41-21bd296bf55c req-18bd71c4-98d9-423c-8590-ff7844b8a906 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:43:59.472873 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-84b3537c-1de2-4306-aa41-21bd296bf55c req-18bd71c4-98d9-423c-8590-ff7844b8a906 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:43:59.484663 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-84b3537c-1de2-4306-aa41-21bd296bf55c req-18bd71c4-98d9-423c-8590-ff7844b8a906 service nova] Creating event network-changed:cf5bfb83-fffe-4616-9599-9c83ec953b80 for instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 on hv-cinder-84488 Jul 12 18:43:59.490718 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-84b3537c-1de2-4306-aa41-21bd296bf55c req-18bd71c4-98d9-423c-8590-ff7844b8a906 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203089 Jul 12 18:43:59.495712 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 580/1114] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:43:59.664171 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-130dec07-560b-4f7f-ae2d-35103e962137 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 204 len: 0 microversion: 2.1 time: 0.379317 Jul 12 18:43:59.664757 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 535/1115] 10.222.0.47 () {58 vars in 1238 bytes} [Tue Jul 12 18:43:59 2022] DELETE /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:43:59.673763 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-c7d2cd4a-75cf-4de7-8d11-cd1ccdd5d9ec tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:43:59.674611 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-c7d2cd4a-75cf-4de7-8d11-cd1ccdd5d9ec tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:43:59.682408 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c7d2cd4a-75cf-4de7-8d11-cd1ccdd5d9ec tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:43:59.682987 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c7d2cd4a-75cf-4de7-8d11-cd1ccdd5d9ec tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:43:59.683873 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c7d2cd4a-75cf-4de7-8d11-cd1ccdd5d9ec tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:43:59.684442 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-c7d2cd4a-75cf-4de7-8d11-cd1ccdd5d9ec tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:43:59.831373 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-c7d2cd4a-75cf-4de7-8d11-cd1ccdd5d9ec tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:43:59.839560 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-c7d2cd4a-75cf-4de7-8d11-cd1ccdd5d9ec tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.170093 Jul 12 18:43:59.840129 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 581/1116] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:43:59 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:44:00.859347 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7b2ea09e-b83f-4c03-8945-bc616a2fe657 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:44:00.860050 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7b2ea09e-b83f-4c03-8945-bc616a2fe657 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:44:00.867507 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b2ea09e-b83f-4c03-8945-bc616a2fe657 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:44:00.868078 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b2ea09e-b83f-4c03-8945-bc616a2fe657 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:44:00.869175 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b2ea09e-b83f-4c03-8945-bc616a2fe657 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:44:00.869602 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7b2ea09e-b83f-4c03-8945-bc616a2fe657 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:44:01.100456 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7b2ea09e-b83f-4c03-8945-bc616a2fe657 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:44:01.109650 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7b2ea09e-b83f-4c03-8945-bc616a2fe657 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1569 microversion: 2.1 time: 0.255223 Jul 12 18:44:01.110383 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 536/1117] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:44:00 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1569 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:44:01.989504 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [req-1c4164c5-351c-4227-8742-b5d43a011312 req-1bd5e9f7-e077-41d3-a849-f615f34e3582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dad77cc-8aa1-405e-92b9-1a0a392b3901", "name": "network-vif-deleted", "tag": "cf5bfb83-fffe-4616-9599-9c83ec953b80"}]} {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:44:01.998256 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-1c4164c5-351c-4227-8742-b5d43a011312 req-1bd5e9f7-e077-41d3-a849-f615f34e3582 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:44:01.998698 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [req-1c4164c5-351c-4227-8742-b5d43a011312 req-1bd5e9f7-e077-41d3-a849-f615f34e3582 service nova] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:44:02.011736 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.compute.server_external_events [req-1c4164c5-351c-4227-8742-b5d43a011312 req-1bd5e9f7-e077-41d3-a849-f615f34e3582 service nova] Creating event network-vif-deleted:cf5bfb83-fffe-4616-9599-9c83ec953b80 for instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 on hv-cinder-84488 Jul 12 18:44:02.018687 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [req-1c4164c5-351c-4227-8742-b5d43a011312 req-1bd5e9f7-e077-41d3-a849-f615f34e3582 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158555 Jul 12 18:44:02.019291 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 582/1118] 10.222.0.47 () {64 vars in 1317 bytes} [Tue Jul 12 18:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:44:02.129700 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-21b8cddd-8988-4c78-ab6f-5c9f0b6dae51 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:44:02.131414 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-21b8cddd-8988-4c78-ab6f-5c9f0b6dae51 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:44:02.139371 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-21b8cddd-8988-4c78-ab6f-5c9f0b6dae51 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:44:02.139812 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-21b8cddd-8988-4c78-ab6f-5c9f0b6dae51 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:44:02.140621 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-21b8cddd-8988-4c78-ab6f-5c9f0b6dae51 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:44:02.141048 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-21b8cddd-8988-4c78-ab6f-5c9f0b6dae51 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:44:02.207277 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-21b8cddd-8988-4c78-ab6f-5c9f0b6dae51 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:44:02.216273 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-21b8cddd-8988-4c78-ab6f-5c9f0b6dae51 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1219 microversion: 2.1 time: 0.091140 Jul 12 18:44:02.216886 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 537/1119] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:44:02 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:44:03.236640 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-160c9939-4bac-4e2f-8c9a-ea9dde465cf1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:44:03.237318 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.compute.api [None req-160c9939-4bac-4e2f-8c9a-ea9dde465cf1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118411) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:44:03.244437 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-160c9939-4bac-4e2f-8c9a-ea9dde465cf1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:44:03.244881 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-160c9939-4bac-4e2f-8c9a-ea9dde465cf1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:44:03.245655 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-160c9939-4bac-4e2f-8c9a-ea9dde465cf1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:44:03.246094 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-160c9939-4bac-4e2f-8c9a-ea9dde465cf1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:44:03.281129 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-160c9939-4bac-4e2f-8c9a-ea9dde465cf1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:44:03.281572 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG oslo_concurrency.lockutils [None req-160c9939-4bac-4e2f-8c9a-ea9dde465cf1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:44:03.282079 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.objects.instance [None req-160c9939-4bac-4e2f-8c9a-ea9dde465cf1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lazy-loading 'fault' on Instance uuid 2dad77cc-8aa1-405e-92b9-1a0a392b3901 {{(pid=118411) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:44:03.326943 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.policy [None req-160c9939-4bac-4e2f-8c9a-ea9dde465cf1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c8efca90fa4e309ada93f3eecda4cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb64781270b435aaf0eb5e2c4d290b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118411) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:44:03.340037 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-160c9939-4bac-4e2f-8c9a-ea9dde465cf1 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 200 len: 1224 microversion: 2.1 time: 0.109066 Jul 12 18:44:03.340731 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 583/1120] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:44:03 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:44:04.358451 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f6df9329-65f7-4877-81d9-a86059f2165c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:44:04.359056 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f6df9329-65f7-4877-81d9-a86059f2165c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] [instance: 2dad77cc-8aa1-405e-92b9-1a0a392b3901] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:44:04.366524 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6df9329-65f7-4877-81d9-a86059f2165c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:44:04.366963 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6df9329-65f7-4877-81d9-a86059f2165c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:44:04.367736 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6df9329-65f7-4877-81d9-a86059f2165c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:44:04.368162 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6df9329-65f7-4877-81d9-a86059f2165c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Lock "f6a061b3-df1d-42b4-9542-23af2c3404e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:44:04.382346 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-f6df9329-65f7-4877-81d9-a86059f2165c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] HTTP exception thrown: Instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 could not be found. Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f6df9329-65f7-4877-81d9-a86059f2165c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Request method failure captured: Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 HTTP/1.1 Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Connection: close Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Host: 10.222.0.47 Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.9 Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABizb_hd0Zc6i6FJk9zNDz_nCJRMevPimVz15lT1L68QMJHr2Ex6y4tSCckRYku-_CsPdQzDRxQwiRt1XRPoUaJ4VyzsO0gOkz4EYg--Z8UBljxLKhtX6NOLGWZ5b7DzbPSLZFEWgTS5djPFBPFbCrGNS61bLkqzEPcpZ45cyDjy9ERXn8 Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Id: cbb64781270b435aaf0eb5e2c4d290b0 Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-TestShelveInstance-1715327172 Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Role: member,reader Jul 12 18:44:04.384368 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Roles: member,reader Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cbb64781270b435aaf0eb5e2c4d290b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/cbb64781270b435aaf0eb5e2c4d290b0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_cbb64781270b435aaf0eb5e2c4d290b0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/cbb64781270b435aaf0eb5e2c4d290b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}] Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-TestShelveInstance-1715327172 Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Id: cbb64781270b435aaf0eb5e2c4d290b0 Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-TestShelveInstance-1715327172 Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User: tempest-TestShelveInstance-1715327172-project Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Id: 11c8efca90fa4e309ada93f3eecda4cc Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-TestShelveInstance-1715327172-project Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: method: > Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: exception: Instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 could not be found. Jul 12 18:44:04.386263 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: action_args: {'id': '2dad77cc-8aa1-405e-92b9-1a0a392b3901'} Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 could not be found. Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:44:04.387420 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 could not be found. Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 could not be found. Jul 12 18:44:04.389182 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 12 18:44:04.390834 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f6df9329-65f7-4877-81d9-a86059f2165c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Returning 404 to user: Instance 2dad77cc-8aa1-405e-92b9-1a0a392b3901 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:44:04.390834 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f6df9329-65f7-4877-81d9-a86059f2165c tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901" status: 404 len: 111 microversion: 2.1 time: 0.031353 Jul 12 18:44:04.390834 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 538/1121] 10.222.0.47 () {58 vars in 1235 bytes} [Tue Jul 12 18:44:04 2022] GET /compute/v2.1/servers/2dad77cc-8aa1-405e-92b9-1a0a392b3901 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:44:04.635896 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: DEBUG nova.api.openstack.wsgi [None req-465e7df8-0bbb-4110-8910-c7a4ec97b513 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] Calling method '.version_select at 0x7f1bb0ae7ee0>' {{(pid=118411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:44:04.756409 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO nova.api.openstack.requestlog [None req-465e7df8-0bbb-4110-8910-c7a4ec97b513 tempest-TestShelveInstance-1715327172 tempest-TestShelveInstance-1715327172-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-862531149" status: 202 len: 0 microversion: 2.1 time: 0.124759 Jul 12 18:44:04.756993 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: [pid: 118411|app: 0|req: 584/1122] 10.222.0.47 () {58 vars in 1250 bytes} [Tue Jul 12 18:44:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-862531149 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:44:58.691814 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:44:58.692499 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Tue Jul 12 18:44:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:45:19.380383 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:45:19.381018 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Tue Jul 12 18:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:45:25.843520 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:45:25.844109 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Tue Jul 12 18:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:47:03.430801 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:47:03.431450 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Tue Jul 12 18:47:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:47:18.368049 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:47:18.368706 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Tue Jul 12 18:47:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:48:18.701603 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:48:18.702818 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Tue Jul 12 18:48:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:48:39.389029 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:48:39.389684 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Tue Jul 12 18:48:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:48:45.851950 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:48:45.852967 dv-cinder-844881-1-iscsi devstack@n-api.service[118410]: Tue Jul 12 18:48:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:49:02.049525 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:49:02.050108 dv-cinder-844881-1-iscsi devstack@n-api.service[118411]: Tue Jul 12 18:49:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!